-- Logs begin at Wed 2022-09-07 12:20:12 UTC, end at Wed 2022-09-07 13:54:28 UTC. -- Sep 07 13:22:56.506559 dv-cinder-856259-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 13:22:56.515943 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 13:22:56 2022] *** Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: nodename: dv-cinder-856259-1-iscsi Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: machine: x86_64 Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: clock source: unix Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: pcre jit disabled Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: detected number of CPU cores: 4 Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: current working directory: / Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: detected binary path: /usr/bin/uwsgi-core Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: your processes number limit is 47680 Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: your memory page size is 4096 bytes Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: detected max file descriptor number: 2048 Sep 07 13:22:56.517954 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: lock engine: pthread robust mutexes Sep 07 13:22:56.518828 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: thunder lock: enabled Sep 07 13:22:56.518828 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 13:22:56.518828 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 13:22:56.557867 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: Python main interpreter initialized at 0x555e3b41a9c0 Sep 07 13:22:56.557867 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: python threads support enabled Sep 07 13:22:56.557867 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: your server socket listen backlog is limited to 100 connections Sep 07 13:22:56.557867 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: your mercy for graceful operations on workers is 90 seconds Sep 07 13:22:56.558306 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 13:22:56.558306 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: *** Operational MODE: preforking *** Sep 07 13:22:56.558562 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: *** uWSGI is running in multiple interpreter mode *** Sep 07 13:22:56.558562 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: spawned uWSGI master process (pid: 129811) Sep 07 13:22:56.558773 dv-cinder-856259-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 13:22:56.559870 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: spawned uWSGI worker 1 (pid: 129812, cores: 1) Sep 07 13:22:56.559870 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: spawned uWSGI worker 2 (pid: 129813, cores: 1) Sep 07 13:22:56.559870 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 13:22:57.239521 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:22:57.240135 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:22:58.350243 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:22:58.350243 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: from cryptography.utils import int_from_bytes Sep 07 13:22:58.350846 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:22:58.350846 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: from cryptography.utils import int_from_bytes Sep 07 13:22:58.355633 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:22:58.355633 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: from cryptography.utils import int_from_bytes Sep 07 13:22:58.356103 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:22:58.356103 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: from cryptography.utils import int_from_bytes Sep 07 13:23:00.878315 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:23:00.879089 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:23:00.879089 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:23:00.879462 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:23:00.879713 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:23:00.880092 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.880409 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:23:00.880763 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.880856 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:23:00.880943 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.881030 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.881197 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:23:00.881328 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.881554 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:23:00.881652 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.881805 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:23:00.881930 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.882186 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.882286 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.882505 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.882598 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.882784 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.882875 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.883139 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.883245 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.883463 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-1-iscsi {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.883573 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.883771 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.883873 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.884065 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.884150 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.884368 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.884454 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.884674 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.884762 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.884927 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.885015 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.885241 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.885395 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.885556 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-1-iscsi {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.885656 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.885868 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.886081 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.886185 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.886459 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.886552 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.886770 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.886875 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.887087 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.887209 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.887407 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.887509 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.887714 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.887864 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.888016 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.888204 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.888392 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.888556 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.888712 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.888836 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.888983 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.889100 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.889255 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.889417 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.889546 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-1-iscsi {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.889691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.889861 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.889993 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.890295 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.890419 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.890926 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.891109 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.891232 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.891393 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.891520 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.891675 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.891829 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-1-iscsi {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.891955 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.892101 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.892241 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.892369 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.892457 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.892595 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.892685 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.892898 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.893024 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.893286 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.893374 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.893609 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.893729 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.893926 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.894029 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.894218 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.894304 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.894520 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.894613 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.894876 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.895024 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.895160 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.895246 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.895460 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.895557 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.895805 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896085 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896188 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896269 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896347 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896424 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896586 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896699 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896898 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.896996 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.897210 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.897300 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.897457 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.897546 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.897691 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.897811 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.898000 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.898082 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.898374 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.898522 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.898614 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.898695 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.898899 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.899014 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.899185 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.899280 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.899433 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.899528 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.899748 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.899891 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.900060 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.900154 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.900363 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.900458 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.900661 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.900758 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.900968 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.901053 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.901273 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.901373 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.901574 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.901662 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.901873 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.901958 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.902173 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.902257 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.902473 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.902571 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.902783 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.902884 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.903139 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.903230 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.903506 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.903603 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.903810 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.903893 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.904114 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.904228 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.904422 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.904518 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.904736 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.904823 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.905035 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.905128 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.905333 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.905418 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.906166 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.906280 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.906464 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.906567 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.906802 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.906892 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.907119 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.907224 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.907424 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.907535 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.907720 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.907805 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.908020 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.908103 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.908353 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.908571 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.908720 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.908870 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909017 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909118 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909239 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909340 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909533 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909618 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909831 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.909916 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.910134 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.910277 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.910432 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.910519 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.910731 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.910830 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.911052 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.911156 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.911355 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.911447 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.911650 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.911743 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.911947 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.912033 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.912272 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.912369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.912543 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.912627 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.912852 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.912950 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.913164 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.913251 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.913487 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.913585 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.913789 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.914167 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.914264 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.914390 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.914479 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.914778 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.914907 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.915037 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.915121 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.915327 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.915415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.915696 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.915805 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.915926 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.916014 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.916223 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.916317 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.916531 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.916629 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.916885 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.916984 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.917185 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.917272 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.917490 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.917587 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.917788 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.917873 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.918082 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.918166 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.918383 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.918490 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.918682 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.918776 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919018 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919113 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919304 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919602 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919695 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919894 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.919986 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.920194 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.920281 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.920491 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.920576 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.920786 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.920913 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.921082 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.921168 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.921463 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.922116 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.922303 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.922555 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.922643 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.922880 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.923022 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.924942 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925033 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925129 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925211 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925289 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925366 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925444 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925522 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.925609 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.925689 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.926003 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.926103 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.926184 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.926272 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.926352 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.927318 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:23:00.927419 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.927502 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.927580 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.927683 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.927765 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.927851 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.927931 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928012 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928012 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928200 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928282 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928350 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928415 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928479 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928553 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928621 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928741 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928816 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928883 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.928948 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.929023 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.929150 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.929222 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.929391 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932271 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932271 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932443 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932532 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932613 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932768 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932845 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.932932 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933020 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933100 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933177 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933254 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933339 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933427 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933518 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933598 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933674 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933755 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933833 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933833 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.933995 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934075 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934153 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934239 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934318 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934405 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934478 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934556 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934633 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934710 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.934933 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.935054 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.935263 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.935351 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.935593 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938275 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938275 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938465 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938534 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938611 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938688 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938820 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.938918 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939022 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939104 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939178 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939244 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939311 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939395 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939483 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939483 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939658 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939746 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939828 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939909 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.939976 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940049 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940134 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940202 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940285 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940354 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940354 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940487 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940487 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940629 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940629 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940766 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.940936 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.941022 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.941240 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.941324 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.941548 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.941643 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.941853 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.941948 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.942147 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.942232 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.942445 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.942533 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.942744 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.942828 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.943077 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.943188 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.943381 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.943469 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.943703 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.943807 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.944025 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.944121 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.944328 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.944427 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.944669 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.944848 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.944996 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.945152 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.945294 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.945435 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.945575 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.945714 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.945860 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.946019 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.946165 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.946320 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.946483 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.946632 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.946783 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.946926 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.947099 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.947244 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.947403 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.947548 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.947705 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.947849 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.947992 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.948137 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.948277 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.948491 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.948657 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.948804 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.948942 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949083 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949226 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949379 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949477 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949560 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949638 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949815 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.949942 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.950123 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.950247 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.950429 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.950564 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.950746 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.950869 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.951080 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.951200 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.951514 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.951602 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.951841 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.951927 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.952141 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.952229 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.952454 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.952541 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.952805 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.952932 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.953259 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.953345 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.953573 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.953689 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.953864 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.953959 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.954188 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.954282 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.954493 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.954582 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.954794 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.954903 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.955118 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.955205 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.955413 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.955499 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.955710 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.955885 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956007 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956094 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956302 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956395 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956598 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956692 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956893 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.956981 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.957201 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.957287 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.957508 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.957609 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.957803 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.957896 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.958098 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.958191 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.958394 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.958477 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.958722 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.958817 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.959041 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.959142 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.959379 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.959463 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.959696 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.959782 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.960009 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.960111 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.960316 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.960460 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.960626 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.960745 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.960930 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.961031 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.961238 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.961365 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.961538 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.961660 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.961841 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.961946 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.962143 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.962235 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.962449 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.962574 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.962759 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.962887 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.963076 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.963165 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.963384 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.963469 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.963688 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.963783 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.963994 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.964079 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.964298 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.964394 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.964594 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.964680 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.964905 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.965019 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.965240 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.965328 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.965551 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.965638 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.965865 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.965960 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.966171 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.966258 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.966480 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.966575 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.966787 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.966906 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.967113 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.967203 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.967421 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.967516 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.967723 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.967808 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.968026 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.968119 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.968854 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.968989 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.969163 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.969282 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.969479 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.969607 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.969783 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.969893 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.970106 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.970247 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.970416 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.970534 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.970726 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.970815 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.971050 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.971143 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.971403 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.971503 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.971730 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.971818 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.972036 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.972132 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.972343 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.972439 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.972657 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.972745 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.972961 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.973056 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.973262 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.973359 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.973568 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.973663 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.973868 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.973955 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.974168 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.974256 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.974466 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.974552 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.974770 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.974856 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.975102 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.975210 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.975408 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.975514 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.975706 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.975797 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.976006 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.976106 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.976306 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.976430 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.976611 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.976716 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.976903 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.977030 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.977227 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.977363 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.977555 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.977661 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.977868 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.977955 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.978173 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.978267 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.978486 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.978581 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.978784 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.978868 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.979103 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.979275 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.979402 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.979502 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.979712 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.979798 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980013 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980100 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980310 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980416 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980607 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980693 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980902 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.980986 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.981233 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.981319 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.981531 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.981630 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.981830 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.981914 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.982142 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.982230 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.982443 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.982529 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.982782 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.982874 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.983111 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.983214 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.983418 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.983505 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.983733 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.983820 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.984705 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.984843 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.985038 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.985244 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.985324 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.985471 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.985613 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.985761 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.985919 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.986069 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.986225 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.986379 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.986542 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.986684 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.986847 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.987024 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.987178 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.987334 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.987485 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.987641 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.987784 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.987948 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.988088 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.988248 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.988400 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.988555 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.988898 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.989000 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.989295 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.989464 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.989609 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.989799 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.989919 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.990167 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.990278 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.990494 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.990598 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.990837 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.990944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.991182 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.991291 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.991503 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.991590 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.991808 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.991897 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.992113 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.992200 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.992413 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.992513 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.992724 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.992870 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993008 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993093 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993307 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993414 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993608 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993696 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993906 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.993997 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.994206 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.994302 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.994506 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.994592 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.994802 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.994891 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.995124 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.995229 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.995425 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.995512 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.995725 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.995812 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.996023 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.996117 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.996331 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.996417 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.996628 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.996714 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.996944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.997032 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.997248 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.997343 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.997547 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.997644 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.997844 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.997932 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.998141 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.998228 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.998439 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.998527 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.998740 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.998829 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.999099 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.999185 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.999631 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.999860 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:00.999945 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.000015 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.000082 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.000149 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.000397 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.000499 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.000767 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.000854 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.001071 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.001158 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.001369 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.001464 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.001671 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.001759 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.001970 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.002062 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.002268 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.002355 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.002564 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.002649 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.002864 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.002957 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.003188 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.003277 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.003491 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.003577 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.003795 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.003880 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.004092 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.004178 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.004394 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.004480 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.004690 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.004776 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.004993 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.005080 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.005291 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.005377 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.005585 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.005678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.005914 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.006002 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.006222 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.006316 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.006516 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.006610 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.006809 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.006896 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.007138 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.007227 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.007435 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.007580 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.007740 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.007826 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.008035 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.008121 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.008331 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.008427 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.008626 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.008720 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.008922 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.009017 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.009221 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.009310 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.009513 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.009598 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.009813 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.009905 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.010111 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.010206 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.010409 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.010503 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.010707 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.010800 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.011028 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.011119 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.011327 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.011416 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.011625 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.011712 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012020 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012121 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012247 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012334 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012551 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012653 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012846 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.012931 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.013150 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.013237 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.013448 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.013542 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.013743 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.013828 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.014038 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.014123 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.014337 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.014432 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.014631 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.014725 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.014928 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.015596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.015779 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.015947 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.016079 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.016241 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.016537 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.016686 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.016837 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.016974 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.017129 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.017314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.017456 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.017597 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.017754 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.017885 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.018027 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.018147 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.018284 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.018408 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.018583 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.018711 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.018924 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.019158 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.019274 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.019465 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.019598 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.019778 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.019902 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.020094 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.020212 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.020408 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.020525 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.020714 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.020832 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.021022 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.021141 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.021325 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.021438 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.021634 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.021722 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.021940 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.022027 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.022249 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.022336 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.022549 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.022637 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.022847 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.022933 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.023186 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.023275 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.023497 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.023593 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.023805 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.023892 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.024113 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.024201 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.024428 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.024515 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.024746 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.024842 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.025043 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.025129 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.025347 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.025435 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.025650 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.025746 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.025953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.026039 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.026252 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.026338 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.026555 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.026650 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.026859 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.026945 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.027187 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.027274 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.027496 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.027599 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.027800 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.027886 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.028103 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.028188 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.028404 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.028492 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.028702 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.028788 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.029004 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.029089 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.029301 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.029389 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.029618 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.029713 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.029923 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.030018 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.030221 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.030394 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.030526 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.030772 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.031514 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.031688 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.031983 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.032080 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.032294 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.032389 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.032593 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.032725 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.033018 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.033105 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.033327 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.033414 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.033646 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.033743 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.033926 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.034013 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.034230 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.034317 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.034540 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.034635 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.034853 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.034948 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.035180 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.035268 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.035509 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.035606 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.035880 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.035966 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.036188 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.036276 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.036494 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.036589 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.036793 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.036887 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.037089 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.037175 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.037387 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.037476 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.037692 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.037779 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.037989 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.038073 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.038286 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.038382 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.038579 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.038664 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.038878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.038992 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.039223 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.039312 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.039524 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.039612 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.039840 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.039989 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.040245 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.040332 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.040573 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.040668 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.040908 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.041003 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.041268 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.041354 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.041573 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.041659 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.041889 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.041987 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.042203 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.042304 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.042514 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.042609 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.042811 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.042896 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.043138 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.043241 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.043445 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.043532 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.043747 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.043840 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.044061 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.044155 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.044365 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.044453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.044669 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.044757 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.044965 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.045052 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.045264 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.045359 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.045579 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.045667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.045885 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.045967 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.046189 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.046302 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.046687 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.047290 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.047613 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.047923 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.048289 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.048653 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.048957 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.049256 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.049565 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.049866 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.050060 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.050162 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.050405 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.050501 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.050730 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.050817 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.051078 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.051169 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.051387 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.051556 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.051707 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.051800 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.051998 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.052088 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.052313 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.052420 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.052621 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.052709 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.052928 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.053017 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.053250 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.053351 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.053556 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.053645 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.053867 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.053954 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.054177 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.054266 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.054475 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.054561 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.054776 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.054863 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.055105 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.055209 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.055405 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.055493 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.055704 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.055801 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.056005 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.056089 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.056574 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.056666 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.056874 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.056971 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.057191 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.057279 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.057490 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.057577 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.057813 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.057909 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.058119 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.058208 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.058422 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.058516 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.058724 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.058829 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.059052 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.059143 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.059394 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.059494 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.059697 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.059798 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.060014 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.060103 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.060321 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.060413 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.060620 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.060713 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.060927 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.061015 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.061226 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.061315 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.061527 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.061616 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.061825 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.061939 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.062169 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.062256 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.062467 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.062557 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.062803 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.062889 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.063125 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.063218 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.063426 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.063516 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.063732 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.063829 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.064033 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.064120 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.064332 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.064431 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.064630 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.064717 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.064935 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.065036 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.065231 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.065319 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.065528 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.065616 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.065826 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.065921 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.066143 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.066230 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.066440 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.066526 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.066754 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.066849 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.067086 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.067179 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.067390 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.067487 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.067695 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.067792 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.067992 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.068087 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.068302 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.068388 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.068613 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.068701 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.068934 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.069019 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.069239 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.069325 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.069556 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.069644 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.069921 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.070012 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.070174 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.070275 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.070483 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.070727 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.070810 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.071074 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.071164 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.071387 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.071485 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.071698 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.071793 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.072007 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.072095 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.072315 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.072402 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.072621 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.072707 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.072925 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.073011 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.073231 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.073479 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.073566 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.073808 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.073895 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.074122 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.074222 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.074436 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.074524 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.074748 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.074837 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.075089 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.075182 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.075403 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.075501 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.075713 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.075802 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.076020 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.076117 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.076327 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.076415 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.076635 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.076730 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.076961 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.077063 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.077275 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.077363 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.078108 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.078219 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.078421 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.078538 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.078730 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.078942 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.079060 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.079284 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.079373 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.079600 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.079688 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.079912 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.080012 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.080285 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.080371 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.080592 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.080679 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.080895 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.081063 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.081199 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.081292 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.081508 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.081607 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.081819 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.081906 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.082128 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.082213 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.082433 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.082509 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.082741 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.082830 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.083072 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.083174 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.083380 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.083597 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.083693 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.083906 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.084001 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.084230 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.084318 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.084549 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.084646 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.084865 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.084952 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.085177 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.085271 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.085493 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.085581 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.085803 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.085891 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.086106 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.086199 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.086407 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.086627 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.086714 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.086940 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.087083 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.087292 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.087389 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.087617 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.087704 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.087923 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.088010 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.088222 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.088318 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.088536 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.088621 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.088836 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.088921 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.089148 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.089364 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.089452 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.089710 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.089797 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.090022 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.090118 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.090317 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.090408 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.090632 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.090720 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.090941 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.091056 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.091269 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.091369 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.091587 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.091675 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.091886 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.091982 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.092192 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.092413 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.092501 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.092754 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.092867 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.093066 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.093190 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.094029 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.094639 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.094750 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.094850 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.094922 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095054 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095129 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095197 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095277 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095420 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095510 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095723 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.095819 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.096025 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.096128 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.096338 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.096427 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.096644 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.096731 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.096943 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.097041 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.097243 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.097333 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.097554 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.097642 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.097859 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.098005 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.098164 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.098314 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.098470 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.098628 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.098767 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.098930 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.099116 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.099263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.099417 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.099575 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.099716 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.099885 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.100014 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.100231 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.100319 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.100541 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.100646 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.100841 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.100937 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.101161 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.101250 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.101462 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.101558 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.101761 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.101848 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.102056 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.102142 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.102362 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.102466 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.102721 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.102819 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.102967 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.103074 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.103341 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.103449 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.103652 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.103741 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.103959 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.104048 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.104276 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.104546 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.104634 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.104868 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.104954 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.105179 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.105276 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.105489 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.105577 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.105807 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.105894 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.106115 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.106216 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.106420 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.106509 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.106724 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.106811 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.107070 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.107175 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.107381 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.107634 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.107784 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.107957 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.108062 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.108278 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.108372 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.108583 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.108684 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.108995 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.109224 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.109355 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.109546 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.109752 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.110040 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.110128 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.110359 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.110447 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.110665 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.110762 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.110992 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.111169 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.111308 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.111398 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.111598 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.111686 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.111908 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.112005 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.112250 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.112338 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.112563 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.112650 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.112869 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.112971 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.113178 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.113266 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.113483 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.113579 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.113783 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.113872 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.114087 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.114173 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.114389 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.114482 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.114691 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.114786 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.115018 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.115113 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.115332 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.115422 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.115667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.115763 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.115982 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.116070 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.116295 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.116603 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.116690 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.116914 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.117009 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.117225 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.117321 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.117528 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.117617 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.117832 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.117920 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.118135 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.118227 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.118445 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.118533 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.118765 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.118854 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.119112 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.119214 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.119405 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.119493 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.119742 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.120080 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.120167 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.120391 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.120479 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.120708 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.120797 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.121009 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.121104 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.121310 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.121447 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.121609 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.121697 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.121914 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.122001 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.122224 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.122312 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.122527 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.122613 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.122826 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.122922 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.123148 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.123239 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.123454 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.123541 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.123753 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.123852 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.124053 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.124148 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.124354 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.124637 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.124735 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.124826 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.124985 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.125240 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.125330 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.125549 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.125646 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.125850 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.125939 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.126150 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.126239 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.126446 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.126542 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.126743 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.126872 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.127064 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.127155 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.127366 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.127465 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.127665 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.127751 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.127959 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.128053 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.128255 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.128396 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.128551 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.128640 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.128847 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.128935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.129143 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.129232 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.129438 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.129526 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.129732 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.129819 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.130027 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.130124 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.130328 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.130416 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.130626 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.130720 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.130923 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.131030 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.131265 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.131354 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.131561 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.131649 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.131857 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.131955 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.132213 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.132314 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.132507 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.132606 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.132815 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.132903 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.133130 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.133217 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.133433 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.133529 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.133749 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.133838 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.134053 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.134140 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.134362 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.134457 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.134678 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.134766 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.135019 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.135112 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.135307 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.135404 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.135623 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.135709 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.135925 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.136010 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.136228 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.136317 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.136535 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.136621 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.136839 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.137000 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.137150 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.137239 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.137455 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.137549 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.137775 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.137875 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.138078 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.138165 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.138375 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.138462 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.138675 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.138770 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.138999 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.139090 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.139316 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.139402 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.139620 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.139786 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.139922 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.140008 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.140780 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.140874 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.141094 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.141199 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.141400 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.141488 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.141704 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.141795 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.142009 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.142098 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.142312 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.142399 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.142621 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.142707 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.142924 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.143032 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.143270 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.143358 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.143583 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.143670 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.143891 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.143988 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.144211 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.144300 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.144529 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.144624 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.144794 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:23:01.144880 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.145136 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.145454 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.145793 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.146099 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.146434 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.146755 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.147090 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.147400 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.147715 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:23:01.147936 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:23:01.302639 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO dbcounter [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Registered counter for database nova_api Sep 07 13:23:01.302852 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO dbcounter [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Registered counter for database nova_api Sep 07 13:23:01.324100 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_db.sqlalchemy.engines [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.326118 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.331979 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writer thread running {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:01.333783 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writer thread running {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:01.397137 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.context [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6(cell1) {{(pid=129812) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:23:01.401263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.401762 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.401986 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.context [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6(cell1) {{(pid=129813) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:23:01.403419 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.404195 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.404646 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.406933 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_concurrency.lockutils [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.407127 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.407465 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_concurrency.lockutils [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.409236 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_concurrency.lockutils [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.409357 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO dbcounter [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Registered counter for database nova_cell0 Sep 07 13:23:01.410020 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_concurrency.lockutils [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.410480 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_concurrency.lockutils [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.412616 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_concurrency.lockutils [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.413890 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO dbcounter [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Registered counter for database nova_cell1 Sep 07 13:23:01.414925 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO dbcounter [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Registered counter for database nova_cell0 Sep 07 13:23:01.419601 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO dbcounter [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Registered counter for database nova_cell1 Sep 07 13:23:01.422561 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.424217 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.428918 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_db.sqlalchemy.engines [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.430012 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_db.sqlalchemy.engines [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.430601 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writer thread running {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:01.433822 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writer thread running {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:01.439446 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writer thread running {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:01.439789 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writer thread running {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:01.593575 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO dbcounter [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Registered counter for database nova_cell0 Sep 07 13:23:01.597936 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO dbcounter [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Registered counter for database nova_cell0 Sep 07 13:23:01.603959 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.607997 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG oslo_db.sqlalchemy.engines [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:23:01.609302 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writer thread running {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:01.613812 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writer thread running {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:23:02.074175 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: WARNING keystonemiddleware.auth_token [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:23:02.082414 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: WARNING keystonemiddleware.auth_token [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:23:02.130494 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: WARNING keystonemiddleware.auth_token [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:23:02.138072 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: WARNING keystonemiddleware.auth_token [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:23:02.440407 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: WARNING keystonemiddleware.auth_token [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:23:02.446410 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: WARNING keystonemiddleware.auth_token [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:23:02.452476 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e3b41a9c0 pid: 129812 (default app) Sep 07 13:23:02.455197 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:02.456374 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 Sep 07 13:23:02.456767 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Wed Sep 7 13:23:02 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:02.490451 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: WARNING keystonemiddleware.auth_token [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:23:02.496536 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: WARNING keystonemiddleware.auth_token [None req-92fea479-d950-4ffc-819e-b52092e81c9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:23:02.502535 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e3b41a9c0 pid: 129813 (default app) Sep 07 13:24:38.202757 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:38.204481 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Sep 07 13:24:38.207329 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:38.218317 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writing DB stats nova_api:SELECT=3 {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:38.219305 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writing DB stats nova_cell0:SELECT=3 {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:38.220393 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writing DB stats nova_cell1:SELECT=3 {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:38.222372 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:39.227331 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-04c83f33-bb43-4c8d-a76b-6e04ba314dcd admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:39.265262 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-04c83f33-bb43-4c8d-a76b-6e04ba314dcd admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.052886 Sep 07 13:24:39.271087 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 7 13:24:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:42.184164 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:42.185320 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-1c2be51a-6afe-4cc4-a46f-06febea3c7ba None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Sep 07 13:24:42.185982 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:24:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:42.719943 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-61c823f8-d7b4-4b36-9d74-b9952a5044c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:42.863825 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-61c823f8-d7b4-4b36-9d74-b9952a5044c2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.670413 Sep 07 13:24:42.864772 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:24:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:24:42.879709 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_api:SELECT=3 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:42.880564 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_cell1:SELECT=3 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:42.883074 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_cell0:SELECT=3 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:42.889901 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:43.115491 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-84e3844f-ddf0-45e4-b671-a14493360e08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:43.272721 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-84e3844f-ddf0-45e4-b671-a14493360e08 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.398208 Sep 07 13:24:43.273484 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 7 13:24:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:46.204705 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-61c823f8-d7b4-4b36-9d74-b9952a5044c2 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:46.205868 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-61c823f8-d7b4-4b36-9d74-b9952a5044c2 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 Sep 07 13:24:46.206409 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:24:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:47.126817 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-5407477b-3df2-453a-96ae-dd24a3a9e246 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "id": "d1", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:47.275837 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-5407477b-3df2-453a-96ae-dd24a3a9e246 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.062344 Sep 07 13:24:47.283184 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:24:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:24:47.290362 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-19fe67f7-63f6-4d9f-aa10-6200cf54f07f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:47.424247 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-19fe67f7-63f6-4d9f-aa10-6200cf54f07f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137696 Sep 07 13:24:47.424987 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 7 13:24:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:50.603105 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-5407477b-3df2-453a-96ae-dd24a3a9e246 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:50.604795 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-5407477b-3df2-453a-96ae-dd24a3a9e246 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 07 13:24:50.605205 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:51.196499 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-a61ed496-255d-44a7-95ce-e30ba26e31bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:51.289356 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-a61ed496-255d-44a7-95ce-e30ba26e31bc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.677039 Sep 07 13:24:51.298103 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:24:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:24:51.304141 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-048d02c9-abe5-431c-bd7b-e202bf550b7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:51.403729 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-048d02c9-abe5-431c-bd7b-e202bf550b7d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103824 Sep 07 13:24:51.404248 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 7 13:24:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:54.331484 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-a61ed496-255d-44a7-95ce-e30ba26e31bc admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.332511 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-a61ed496-255d-44a7-95ce-e30ba26e31bc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 07 13:24:54.333132 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:24:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:54.879508 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-6993ba53-90bf-4c4e-b20a-fd2ca6ab2faf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "disk": 10}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:54.995135 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-6993ba53-90bf-4c4e-b20a-fd2ca6ab2faf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.654958 Sep 07 13:24:54.996477 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:24:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:24:55.009614 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-e9b8f734-62a9-42eb-b4c7-1b90bfa0bf19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:55.180856 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-e9b8f734-62a9-42eb-b4c7-1b90bfa0bf19 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.175835 Sep 07 13:24:55.191842 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 7 13:24:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:58.143725 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-6993ba53-90bf-4c4e-b20a-fd2ca6ab2faf admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:58.144612 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-6993ba53-90bf-4c4e-b20a-fd2ca6ab2faf admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 07 13:24:58.145016 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:58.727713 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-f0987e47-9e20-4109-b5c4-6677d456fa36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "swap": 0}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:58.814358 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-f0987e47-9e20-4109-b5c4-6677d456fa36 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.656457 Sep 07 13:24:58.815426 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:24:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:24:58.836072 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-a0c39fd8-f619-48dd-9560-8f724ed1277f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:58.967304 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-a0c39fd8-f619-48dd-9560-8f724ed1277f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135376 Sep 07 13:24:58.968124 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 7 13:24:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:02.559341 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-f0987e47-9e20-4109-b5c4-6677d456fa36 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:02.560408 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-f0987e47-9e20-4109-b5c4-6677d456fa36 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Sep 07 13:25:02.560840 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:03.169778 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-0d0fa3ff-fe26-477a-85d5-d3877e3756b2 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:03.198413 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-0d0fa3ff-fe26-477a-85d5-d3877e3756b2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.628559 Sep 07 13:25:03.199017 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 7 13:25:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:06.132880 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-f0987e47-9e20-4109-b5c4-6677d456fa36 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:06.133917 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-f0987e47-9e20-4109-b5c4-6677d456fa36 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 07 13:25:06.134322 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:25:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:06.703015 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-23205b1b-3072-4904-a76c-a5e1abda4b1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "swap": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:06.784679 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-23205b1b-3072-4904-a76c-a5e1abda4b1f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.641917 Sep 07 13:25:06.785320 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:25:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:25:06.799293 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-719b6ddf-1c44-4811-a3ec-25d4ef7a0267 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:06.929129 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-719b6ddf-1c44-4811-a3ec-25d4ef7a0267 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133700 Sep 07 13:25:06.929950 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 7 13:25:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:10.070022 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-23205b1b-3072-4904-a76c-a5e1abda4b1f admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:10.071707 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-23205b1b-3072-4904-a76c-a5e1abda4b1f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Sep 07 13:25:10.072335 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:10.676634 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-12689946-c576-4e2b-8737-77b37f2880ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "swap": 0}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:10.683233 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:10.786644 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-12689946-c576-4e2b-8737-77b37f2880ff admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.706556 Sep 07 13:25:10.803463 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:25:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:25:10.803619 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-bb7c4c6e-6e9c-442d-bb53-0d3c5a439e80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:10.910256 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-bb7c4c6e-6e9c-442d-bb53-0d3c5a439e80 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112647 Sep 07 13:25:10.911444 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 7 13:25:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:13.811602 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-12689946-c576-4e2b-8737-77b37f2880ff admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:13.813429 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-12689946-c576-4e2b-8737-77b37f2880ff admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Sep 07 13:25:13.819172 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:14.494841 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-5ecc3441-5ecd-4860-9812-87de51fe73f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3", "ram": 4096, "swap": 0}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:14.585058 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-5ecc3441-5ecd-4860-9812-87de51fe73f3 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.758764 Sep 07 13:25:14.586090 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:25:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:25:14.608999 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-b45ea6a6-75c4-4231-b5c3-a32b5f0f3c6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:14.688955 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-b45ea6a6-75c4-4231-b5c3-a32b5f0f3c6e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088300 Sep 07 13:25:14.689644 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 7 13:25:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:17.758007 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-5ecc3441-5ecd-4860-9812-87de51fe73f3 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:17.760507 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-5ecc3441-5ecd-4860-9812-87de51fe73f3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003267 Sep 07 13:25:17.767472 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:18.480490 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-75c0c543-af63-4c1a-afc6-11b0ff771aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:18.576790 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-75c0c543-af63-4c1a-afc6-11b0ff771aaa admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.797825 Sep 07 13:25:18.581664 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:25:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:25:18.587173 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-6b1a6ac3-4683-4ca7-b70a-e6a8af178d06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:18.593179 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:18.711138 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-6b1a6ac3-4683-4ca7-b70a-e6a8af178d06 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127944 Sep 07 13:25:18.712996 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 7 13:25:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:21.690481 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-75c0c543-af63-4c1a-afc6-11b0ff771aaa admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:21.693078 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-75c0c543-af63-4c1a-afc6-11b0ff771aaa admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003094 Sep 07 13:25:21.693784 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:22.317310 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-e5bb67bb-3e49-45ad-b625-e77af208da74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:22.455395 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-e5bb67bb-3e49-45ad-b625-e77af208da74 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.748688 Sep 07 13:25:22.489935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 7 13:25:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:25:22.490789 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-f15b03ac-57c6-43d9-88e4-7d424e70a602 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:23.084841 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-f15b03ac-57c6-43d9-88e4-7d424e70a602 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.617360 Sep 07 13:25:23.094890 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 7 13:25:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:39.354655 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-e5bb67bb-3e49-45ad-b625-e77af208da74 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:39.355724 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-e5bb67bb-3e49-45ad-b625-e77af208da74 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Sep 07 13:25:39.356136 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:25:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:39.363715 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:39.803634 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-1be94fe3-b4ce-47ae-a98d-e9bdb623e982 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:39.824287 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-1be94fe3-b4ce-47ae-a98d-e9bdb623e982 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.461360 Sep 07 13:25:39.832576 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 7 13:25:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:25:41.625294 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-e5bb67bb-3e49-45ad-b625-e77af208da74 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:41.628747 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-e5bb67bb-3e49-45ad-b625-e77af208da74 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001825 Sep 07 13:25:41.628747 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:42.257552 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-a7fc91a5-7820-4549-a0b7-5b7ed19ef4d7 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:42.264533 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.wsgi [None req-a7fc91a5-7820-4549-a0b7-5b7ed19ef4d7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-a7fc91a5-7820-4549-a0b7-5b7ed19ef4d7 admin admin] Request method failure captured: Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Accept: application/json Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Accept-Encoding: gzip, deflate Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Connection: keep-alive Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Content-Length: 0 Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Host: 10.222.0.62 Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Openstack-Api-Version: compute 2.92 Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Openstack-System-Scope: None Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: User-Agent: python-novaclient Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Auth-Token: gAAAAABjGJvVlKYOQ84JRCqut66tSyre6qEXv_mNwjMeuIFQk6d9Rm9gM-c7ZvH0HY5BGtXhQsRLhxODuy6wdiYkwZ4fhXjZ9UkIhkvJ6CsIrCFJDBfmzNbWhqZTxs_0EB3tI6FUNqtCa4ZLJlMolm-zX7H1h3WXFTrgosfhFoofyv1wC7c0Poo Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Domain-Id: None Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Domain-Name: None Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Identity-Status: Confirmed Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Is-Admin-Project: True Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Domain-Id: default Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Domain-Name: Default Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Name: admin Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Role: reader,member,admin Sep 07 13:25:42.267953 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Roles: reader,member,admin Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0ee134892b8643809999afc672e86085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0ee134892b8643809999afc672e86085", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant: admin Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant-Name: admin Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User: admin Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Domain-Id: default Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Domain-Name: Default Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Id: 7a8e484a77ce40f880d21a33a930f0be Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Name: admin Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: method: > Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: exception: Flavor 42 could not be found. Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: action_args: {'id': '42'} Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:42.269796 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:42.270902 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.272415 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-a7fc91a5-7820-4549-a0b7-5b7ed19ef4d7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=129813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:42.273764 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-a7fc91a5-7820-4549-a0b7-5b7ed19ef4d7 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.482391 Sep 07 13:25:42.273764 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 7 13:25:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:42.281012 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-a5505bc2-bd43-41e2-93b8-b6c95da09e20 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:42.288095 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:42.324698 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-a5505bc2-bd43-41e2-93b8-b6c95da09e20 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.048111 Sep 07 13:25:42.325401 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 7 13:25:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:42.338747 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-970d6c9b-6257-45c1-8d3b-a3429ef91604 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:42.363585 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-970d6c9b-6257-45c1-8d3b-a3429ef91604 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028964 Sep 07 13:25:42.364088 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 7 13:25:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:42.375110 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-16dccde7-bf2a-4a72-a77e-9774b36f43fd admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:42.381272 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.wsgi [None req-16dccde7-bf2a-4a72-a77e-9774b36f43fd admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-16dccde7-bf2a-4a72-a77e-9774b36f43fd admin admin] Request method failure captured: Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Accept: application/json Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Accept-Encoding: gzip, deflate Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Connection: keep-alive Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Content-Length: 0 Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Host: 10.222.0.62 Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Openstack-Api-Version: compute 2.92 Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Openstack-System-Scope: None Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: User-Agent: python-novaclient Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Auth-Token: gAAAAABjGJvVlKYOQ84JRCqut66tSyre6qEXv_mNwjMeuIFQk6d9Rm9gM-c7ZvH0HY5BGtXhQsRLhxODuy6wdiYkwZ4fhXjZ9UkIhkvJ6CsIrCFJDBfmzNbWhqZTxs_0EB3tI6FUNqtCa4ZLJlMolm-zX7H1h3WXFTrgosfhFoofyv1wC7c0Poo Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Domain-Id: None Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Domain-Name: None Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Identity-Status: Confirmed Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Is-Admin-Project: True Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Domain-Id: default Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Domain-Name: Default Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Name: admin Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Role: reader,member,admin Sep 07 13:25:42.384596 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Roles: reader,member,admin Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0ee134892b8643809999afc672e86085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0ee134892b8643809999afc672e86085", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant: admin Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant-Name: admin Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User: admin Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Domain-Id: default Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Domain-Name: Default Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Id: 7a8e484a77ce40f880d21a33a930f0be Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Name: admin Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: method: > Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: exception: Flavor 42 could not be found. Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: action_args: {'id': '42'} Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:42.386369 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:42.388254 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:42.389935 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-16dccde7-bf2a-4a72-a77e-9774b36f43fd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=129812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:42.398317 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-16dccde7-bf2a-4a72-a77e-9774b36f43fd admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015041 Sep 07 13:25:42.398317 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 7 13:25:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:43.741092 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-970d6c9b-6257-45c1-8d3b-a3429ef91604 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:43.742171 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-970d6c9b-6257-45c1-8d3b-a3429ef91604 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Sep 07 13:25:43.743233 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:44.394617 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-286ba180-e40e-41af-9e71-6a038f60045c admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.401742 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.wsgi [None req-286ba180-e40e-41af-9e71-6a038f60045c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-286ba180-e40e-41af-9e71-6a038f60045c admin admin] Request method failure captured: Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Accept: application/json Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Accept-Encoding: gzip, deflate Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Connection: keep-alive Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Content-Length: 0 Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Host: 10.222.0.62 Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Openstack-Api-Version: compute 2.92 Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Openstack-System-Scope: None Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: User-Agent: python-novaclient Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Auth-Token: gAAAAABjGJvXrhdkX46LP9PZrEDVJuWy9Ezl0aF-jNhq5V-v3JDcf-ff-0is75ASCJnPbp8F6O_jo3ulLJg8Qc3LqjWFr0JCjJn963ojdfq72AF1_uTjJnYj1p8gMzR9LrcmkA4Li-S3_VSljVlmoEHKHKPPdct8vaoXQdFwFAhCbrT26yIfcB4 Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Domain-Id: None Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Domain-Name: None Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Identity-Status: Confirmed Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Is-Admin-Project: True Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Domain-Id: default Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Domain-Name: Default Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Name: admin Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Role: reader,member,admin Sep 07 13:25:44.403393 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Roles: reader,member,admin Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0ee134892b8643809999afc672e86085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0ee134892b8643809999afc672e86085", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant: admin Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant-Name: admin Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User: admin Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Domain-Id: default Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Domain-Name: Default Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Id: 7a8e484a77ce40f880d21a33a930f0be Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Name: admin Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: method: > Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: exception: Flavor 84 could not be found. Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: action_args: {'id': '84'} Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:44.404878 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.405678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.406755 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-286ba180-e40e-41af-9e71-6a038f60045c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=129812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:44.407891 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-286ba180-e40e-41af-9e71-6a038f60045c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.520068 Sep 07 13:25:44.407891 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 7 13:25:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 521 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:44.417688 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-8d6d7142-420d-4ed7-ba14-47a0c6da9dcb admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.434232 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-8d6d7142-420d-4ed7-ba14-47a0c6da9dcb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021458 Sep 07 13:25:44.434823 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 7 13:25:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:44.444853 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-1b3821fc-6987-48c1-b341-f5b8bb4643d3 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.460155 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-1b3821fc-6987-48c1-b341-f5b8bb4643d3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018881 Sep 07 13:25:44.460754 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 7 13:25:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:44.471514 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-80e851d3-460f-4007-af1e-9d4812777f02 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.478465 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.wsgi [None req-80e851d3-460f-4007-af1e-9d4812777f02 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-80e851d3-460f-4007-af1e-9d4812777f02 admin admin] Request method failure captured: Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Accept: application/json Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Accept-Encoding: gzip, deflate Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Connection: keep-alive Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Content-Length: 0 Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Host: 10.222.0.62 Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Openstack-Api-Version: compute 2.92 Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Openstack-System-Scope: None Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: User-Agent: python-novaclient Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Auth-Token: gAAAAABjGJvXrhdkX46LP9PZrEDVJuWy9Ezl0aF-jNhq5V-v3JDcf-ff-0is75ASCJnPbp8F6O_jo3ulLJg8Qc3LqjWFr0JCjJn963ojdfq72AF1_uTjJnYj1p8gMzR9LrcmkA4Li-S3_VSljVlmoEHKHKPPdct8vaoXQdFwFAhCbrT26yIfcB4 Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Domain-Id: None Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Domain-Name: None Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Identity-Status: Confirmed Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Is-Admin-Project: True Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Domain-Id: default Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Domain-Name: Default Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Name: admin Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Role: reader,member,admin Sep 07 13:25:44.480944 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Roles: reader,member,admin Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0ee134892b8643809999afc672e86085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0ee134892b8643809999afc672e86085", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant: admin Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant-Name: admin Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User: admin Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Domain-Id: default Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Domain-Name: Default Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Id: 7a8e484a77ce40f880d21a33a930f0be Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Name: admin Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: method: > Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: exception: Flavor 84 could not be found. Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: action_args: {'id': '84'} Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:44.485297 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.486966 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.488314 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-80e851d3-460f-4007-af1e-9d4812777f02 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=129813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:44.489469 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-80e851d3-460f-4007-af1e-9d4812777f02 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014868 Sep 07 13:25:44.489469 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 7 13:25:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:45.878002 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-1b3821fc-6987-48c1-b341-f5b8bb4643d3 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:45.879480 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-1b3821fc-6987-48c1-b341-f5b8bb4643d3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001874 Sep 07 13:25:45.879999 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:46.492313 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-37a002ef-4d8b-4ba0-b2cc-fc94e7fd3958 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:46.500090 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.wsgi [None req-37a002ef-4d8b-4ba0-b2cc-fc94e7fd3958 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-37a002ef-4d8b-4ba0-b2cc-fc94e7fd3958 admin admin] Request method failure captured: Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Accept: application/json Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Accept-Encoding: gzip, deflate Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Connection: keep-alive Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Content-Length: 0 Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Host: 10.222.0.62 Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Openstack-Api-Version: compute 2.92 Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Openstack-System-Scope: None Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: User-Agent: python-novaclient Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Auth-Token: gAAAAABjGJvZVcG0GUk1gIAAzEmpG0KhA8917CJTRtWP7AemTEij0Y0H2QexVDmsgrcpot8sH572b4kPk99T_oYhtHd7RZVk1IR4lFzPUfHUl1f0vfjafCdLYHujz1uQh5AN7b9drgkio7-pKIAglG_DAzf_B-HvBIZg4FO-n5IVc53WPekmoRE Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Domain-Id: None Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Domain-Name: None Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Identity-Status: Confirmed Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Is-Admin-Project: True Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Domain-Id: default Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Domain-Name: Default Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Project-Name: admin Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Role: reader,member,admin Sep 07 13:25:46.501667 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Roles: reader,member,admin Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0ee134892b8643809999afc672e86085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0ee134892b8643809999afc672e86085", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant: admin Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-Tenant-Name: admin Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User: admin Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Domain-Id: default Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Domain-Name: Default Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Id: 7a8e484a77ce40f880d21a33a930f0be Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: X-User-Name: admin Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: method: > Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: exception: Flavor 451 could not be found. Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: action_args: {'id': '451'} Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:46.503495 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:46.504544 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.505806 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-37a002ef-4d8b-4ba0-b2cc-fc94e7fd3958 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=129813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:46.507091 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-37a002ef-4d8b-4ba0-b2cc-fc94e7fd3958 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.482902 Sep 07 13:25:46.507091 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 7 13:25:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:46.515165 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-6cf78097-7798-42c4-a418-3b8417a9d1e3 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:46.531979 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-6cf78097-7798-42c4-a418-3b8417a9d1e3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020359 Sep 07 13:25:46.532579 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 7 13:25:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:46.542896 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:46.560949 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021772 Sep 07 13:25:46.561529 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 7 13:25:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:25:46.576823 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-b224d24f-6808-4253-9f91-ff06472d2a63 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:46.588134 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.wsgi [None req-b224d24f-6808-4253-9f91-ff06472d2a63 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-b224d24f-6808-4253-9f91-ff06472d2a63 admin admin] Request method failure captured: Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Accept: application/json Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Accept-Encoding: gzip, deflate Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Connection: keep-alive Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Content-Length: 0 Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Host: 10.222.0.62 Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Openstack-Api-Version: compute 2.92 Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Openstack-System-Scope: None Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: User-Agent: python-novaclient Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Auth-Token: gAAAAABjGJvZVcG0GUk1gIAAzEmpG0KhA8917CJTRtWP7AemTEij0Y0H2QexVDmsgrcpot8sH572b4kPk99T_oYhtHd7RZVk1IR4lFzPUfHUl1f0vfjafCdLYHujz1uQh5AN7b9drgkio7-pKIAglG_DAzf_B-HvBIZg4FO-n5IVc53WPekmoRE Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Domain-Id: None Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Domain-Name: None Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Identity-Status: Confirmed Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Is-Admin-Project: True Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Domain-Id: default Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Domain-Name: Default Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Project-Name: admin Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Role: reader,member,admin Sep 07 13:25:46.591453 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Roles: reader,member,admin Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0ee134892b8643809999afc672e86085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0ee134892b8643809999afc672e86085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0ee134892b8643809999afc672e86085", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant: admin Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant-Id: 0ee134892b8643809999afc672e86085 Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-Tenant-Name: admin Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User: admin Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Domain-Id: default Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Domain-Name: Default Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Id: 7a8e484a77ce40f880d21a33a930f0be Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: X-User-Name: admin Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: method: > Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: exception: Flavor 451 could not be found. Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: action_args: {'id': '451'} Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:46.593474 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:46.594691 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: ERROR nova.api.openstack.wsgi Sep 07 13:25:46.596263 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-b224d24f-6808-4253-9f91-ff06472d2a63 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=129812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:46.597723 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-b224d24f-6808-4253-9f91-ff06472d2a63 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.025433 Sep 07 13:25:46.597723 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 7 13:25:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 07 13:25:48.081034 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:48.082093 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Sep 07 13:25:48.082670 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:48.725915 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-eba3550e-2f2f-4785-8151-d94eaaeb49a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:48.804426 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-eba3550e-2f2f-4785-8151-d94eaaeb49a9 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.577132 Sep 07 13:25:48.804986 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 7 13:25:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:25:50.154551 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:50.155689 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Sep 07 13:25:50.156143 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:50.784406 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-8b5c8fd8-f622-43a0-84e6-86247c66c544 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:50.879550 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-8b5c8fd8-f622-43a0-84e6-86247c66c544 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.578108 Sep 07 13:25:50.880140 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 7 13:25:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:25:52.245867 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:52.247260 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Sep 07 13:25:52.247760 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:52.918537 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-c3a0e1a6-ccf4-4b86-8661-4adaf458f8a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:53.041092 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-c3a0e1a6-ccf4-4b86-8661-4adaf458f8a8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.648365 Sep 07 13:25:53.042171 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 7 13:25:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:25:54.487438 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:54.489251 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002393 Sep 07 13:25:54.490144 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:55.201237 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-0cd29d01-8793-4080-8438-1922e74e77f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:55.296305 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-0cd29d01-8793-4080-8438-1922e74e77f7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.652030 Sep 07 13:25:55.296944 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 7 13:25:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:25:56.929298 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:56.931311 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002556 Sep 07 13:25:56.932074 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:57.878267 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-ba6d1af2-9ca9-47b0-af86-51db2fcb2784 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:57.914846 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-ba6d1af2-9ca9-47b0-af86-51db2fcb2784 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.698059 Sep 07 13:25:57.915875 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Wed Sep 7 13:25:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:27:00.360866 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:00.361671 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7e5afc5b-9824-4649-bf70-3dab41e76495 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Sep 07 13:27:00.362111 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 7 13:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:00.370752 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:00.832978 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-8465bdb0-c96c-44e4-9997-0507b086fa56 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:00.855999 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-8465bdb0-c96c-44e4-9997-0507b086fa56 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.486686 Sep 07 13:27:00.856549 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 7 13:27:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:27:00.877454 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG dbcounter [-] [129813] Writing DB stats nova_api:SELECT=14 {{(pid=129813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:00.881622 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-7eedb00b-4b11-4f17-91b1-7c8cf56dd30c admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:00.895610 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-7eedb00b-4b11-4f17-91b1-7c8cf56dd30c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013740 Sep 07 13:27:00.895610 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Sep 7 13:27:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:00.903906 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-737fa33a-19fd-4bb7-b773-c2184f7473ef admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:00.911994 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-737fa33a-19fd-4bb7-b773-c2184f7473ef admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011767 Sep 07 13:27:00.912547 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Sep 7 13:27:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:00.926010 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:00.934790 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012584 Sep 07 13:27:00.935383 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Sep 7 13:27:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:00.949456 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-ee96ba37-677c-4b4a-be6f-cab8887cb572 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:00.958815 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-ee96ba37-677c-4b4a-be6f-cab8887cb572 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015085 Sep 07 13:27:00.959444 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Sep 7 13:27:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:20.680984 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:20.682074 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Sep 07 13:30:20.682472 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:30:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:20.828039 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_api:SELECT=6 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:20.981851 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:20.985417 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:20.985899 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:20.986317 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:20.987074 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:20.987522 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:20.987940 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:21.025320 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-0ac8403c-d3c0-4f47-9af2-b8c47232e46e admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197467 Sep 07 13:30:21.026368 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 7 13:30:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:30:22.168317 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:22.169364 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 07 13:30:22.169767 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:30:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:22.377379 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:22.381751 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:22.382251 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:22.382678 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:22.383422 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:22.384405 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:22.384821 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:22.406119 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-225a06dd-50d1-4049-8159-99914277299e admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.090590 Sep 07 13:30:22.406576 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 7 13:30:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:30:33.961716 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:33.963512 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 Sep 07 13:30:33.964031 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:30:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:34.121235 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_cell0:SELECT=4 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:34.121998 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_cell1:SELECT=4 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:34.122783 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG dbcounter [-] [129812] Writing DB stats nova_api:SELECT=8 {{(pid=129812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:34.181317 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:34.185081 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:34.185555 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:34.185982 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:34.186694 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:34.187181 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:34.187709 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:34.217052 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-a2948723-9e85-40b4-8250-8cb7e9b6ad21 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.101455 Sep 07 13:30:34.217634 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 7 13:30:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:30:35.384143 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: DEBUG nova.api.openstack.wsgi [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] Calling method '>' {{(pid=129813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:35.385426 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: INFO nova.api.openstack.requestlog [None req-311c3a06-36b1-45ba-b926-4e4044784a81 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 07 13:30:35.385555 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: [pid: 129813|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 7 13:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:35.599312 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG nova.api.openstack.wsgi [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] Calling method '>' {{(pid=129812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:35.605313 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.605884 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.606373 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.607316 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.607889 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.608452 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: DEBUG oslo_concurrency.lockutils [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.631008 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: INFO nova.api.openstack.requestlog [None req-fe38ba49-3457-4117-9c51-360d62487bd6 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.103538 Sep 07 13:30:35.632202 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: [pid: 129812|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 7 13:30:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:31:33.380063 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: Wed Sep 7 13:31:33 2022 - graceful shutdown triggered... Sep 07 13:31:33.380454 dv-cinder-856259-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 13:31:33.381183 dv-cinder-856259-1-iscsi devstack@n-api.service[129812]: Gracefully killing worker 1 (pid: 129812)... Sep 07 13:31:33.381636 dv-cinder-856259-1-iscsi devstack@n-api.service[129813]: Gracefully killing worker 2 (pid: 129813)... Sep 07 13:31:34.381218 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: worker 1 buried after 1 seconds Sep 07 13:31:34.381218 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: worker 2 buried after 1 seconds Sep 07 13:31:34.381218 dv-cinder-856259-1-iscsi devstack@n-api.service[129811]: goodbye to uWSGI. Sep 07 13:31:34.382885 dv-cinder-856259-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 13:31:34.383459 dv-cinder-856259-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 13:31:34.386141 dv-cinder-856259-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 13:31:34.397204 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 13:31:34 2022] *** Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: nodename: dv-cinder-856259-1-iscsi Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: machine: x86_64 Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: clock source: unix Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: pcre jit disabled Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: detected number of CPU cores: 4 Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: current working directory: / Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: detected binary path: /usr/bin/uwsgi-core Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: your processes number limit is 47680 Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: your memory page size is 4096 bytes Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: detected max file descriptor number: 2048 Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: lock engine: pthread robust mutexes Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: thunder lock: enabled Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 13:31:34.403406 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 13:31:34.445584 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: Python main interpreter initialized at 0x55bde570d9c0 Sep 07 13:31:34.445584 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: python threads support enabled Sep 07 13:31:34.445584 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: your server socket listen backlog is limited to 100 connections Sep 07 13:31:34.445584 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: your mercy for graceful operations on workers is 90 seconds Sep 07 13:31:34.446083 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 13:31:34.446083 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: *** Operational MODE: preforking *** Sep 07 13:31:34.446314 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: *** uWSGI is running in multiple interpreter mode *** Sep 07 13:31:34.446314 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: spawned uWSGI master process (pid: 151537) Sep 07 13:31:34.446585 dv-cinder-856259-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 13:31:34.447216 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: spawned uWSGI worker 1 (pid: 151551, cores: 1) Sep 07 13:31:34.447577 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: spawned uWSGI worker 2 (pid: 151552, cores: 1) Sep 07 13:31:34.447739 dv-cinder-856259-1-iscsi devstack@n-api.service[151537]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 13:31:35.153107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:31:35.241556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:31:36.413178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:31:36.413178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: from cryptography.utils import int_from_bytes Sep 07 13:31:36.414314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:31:36.414314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: from cryptography.utils import int_from_bytes Sep 07 13:31:36.574409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:31:36.574409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: from cryptography.utils import int_from_bytes Sep 07 13:31:36.575442 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:31:36.575442 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: from cryptography.utils import int_from_bytes Sep 07 13:31:39.242540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:31:39.243199 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:31:39.243593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:31:39.243757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:31:39.244045 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:31:39.244412 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.244790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.245125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.245453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.245794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.246113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.246523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.246867 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.247316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.249133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.249133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.249133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-1-iscsi {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.249133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.249133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.249782 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.249782 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.250186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.250481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.250798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.251471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.252134 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.252497 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.253034 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.253167 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.253670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.253976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.254447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.254669 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.255029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.255349 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.255769 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-1-iscsi {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.256096 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.256419 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.256743 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.257175 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.257495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.257818 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.258163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.258503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.258818 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.259181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.259538 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.259838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.260169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.260479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.260795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.261179 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.261438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.261751 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.262063 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.262322 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.262644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.263066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.263366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.273947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.273947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.273947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.273947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.273947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.273947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.275491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.276036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.277970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.278643 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.278825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.279177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.283074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.284260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.284260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.284260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.284260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.284260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.284950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.284950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.285231 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.285699 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.286042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.286364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.286683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.287028 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.287696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.287945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.288589 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.289541 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.289888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.290217 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.290523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.290910 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.291263 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.291586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.291915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.292215 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.292759 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.293092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.293415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.293732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.294051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.294350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.295792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.296083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.296395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.296689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.297010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.297797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.298356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.298821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.299299 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.299636 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.299966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.300398 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.300777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.301134 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.301480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.301825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.302227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.302559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.302886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.303270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.303608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.303931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.304253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.304596 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.304936 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.305356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.305701 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.306227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.306558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.306952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.307401 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.308098 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.308815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.309164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.309683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.310110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.310786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.312784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.312784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.312784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.312784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.312784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.314068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.314068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.314068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.314068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.315055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.315055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.315787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.315787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.316215 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.316453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.316668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.316986 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.317338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.317728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.318206 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.318680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.319200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.319604 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.319863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.320184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.320503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.320797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.321115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.321427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.321744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.322052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.322383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.322723 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.323059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.323802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.324121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.324512 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.324972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.325307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.325878 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.326634 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.326942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.327528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.327768 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.328186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.328667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.329226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.329556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.329942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.330228 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.330610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.331085 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.331426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.331745 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.332083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.332487 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.332956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.333309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.333649 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.334053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.334334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.334711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.335040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.335353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.335623 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.336068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.336294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.336522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.336956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.337190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.337769 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.338010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.338430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.338894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.339420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.346952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.346952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.346952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.346952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.348117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.348117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.350053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.350053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.350524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.351083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.351654 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.352053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.352437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.352873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.353213 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.353584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.353970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.354304 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.354787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.355389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.355786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.356119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.356484 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.356812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.357146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.357658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.358287 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.359150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.359853 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.360387 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.360877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.361449 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.362053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.362588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.363196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.363698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:31:39.364293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:31:39.364474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.364668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:31:39.364912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:31:39.365059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.365476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:31:39.365642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.365894 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.366120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.366274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.366555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.366689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.366912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.367221 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.367363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.367554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.367802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.368032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.368338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.368703 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.368823 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.369302 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.369479 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.369771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.370106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.370349 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.370591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-1-iscsi {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.370848 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.371171 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.371399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.371709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.371926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.372163 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.372163 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.372618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.372886 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.373188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.373419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.373419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.373842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.374098 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.374865 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.375195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.375195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.375195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.376155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.376376 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.376376 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.376867 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.377099 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.377358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.377590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.377590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.378024 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.378237 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.378400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.378583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.378763 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.393395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-1-iscsi {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.393628 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.393774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.393774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.394038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.394176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.394311 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.394450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.394450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.394858 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.395029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.395029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.395190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.395281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.395281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.395425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.395509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.395590 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.395664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.395664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.396032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.396190 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.396438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.398747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.399045 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.399550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.400749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.401034 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.401201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.401201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.401858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.402100 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.402353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.402353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.403163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.403416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.403684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.403938 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.404254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.405074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.405355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.405615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.405890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.406205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.406458 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.406699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.406699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.407255 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.407465 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.407641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.407800 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.407965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.408129 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.408292 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.408490 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.408711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.408882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.409074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.409248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.409411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.409581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.409581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.409873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.410170 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.410783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.411076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.411076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.411076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.411561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.411746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.412196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.412383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.412554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.412710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.412871 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.413292 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.413465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.413631 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.413794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.413949 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.414111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.414273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.414440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.414629 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.414792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.414954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.415155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.415310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.415471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.415641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.415641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.415942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.416103 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.416265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.416427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.416619 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.416860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.417028 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.417184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.417492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.417670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.417906 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.418067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.418227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.418412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.418660 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.418785 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.418939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.424051 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.424475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.424754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.424754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.425286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.425628 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.425883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.426113 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.426298 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.426478 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.426765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.427048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.427253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.427425 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.427753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.427964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.428130 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.428294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.428479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.428646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.428646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.428963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.429126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.429347 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.429599 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.429906 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.430167 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.430465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.431117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.431288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.431457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.431624 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.431788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.431788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.432123 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.432292 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.432479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.432644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.432644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.433407 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.433748 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.434149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.434383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.434617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.434858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.435158 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.435416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.435687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.435963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.436268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.436545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.436813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.437070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.437307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.437593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.437593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.438260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.438539 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.438756 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.438918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.439114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.439289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.439289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.443411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.444187 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.444627 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.444871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.445128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.445393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.445648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.445884 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.445884 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.446344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.446513 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.446513 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.446838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.446914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.446914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.447316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.447497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.447497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.447650 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.447733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.447733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.447873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.447946 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:31:39.448033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448703 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448785 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448867 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.448941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449552 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449627 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449707 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.449997 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450103 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450233 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450425 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450643 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.450944 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.451578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.451664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.451737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.451822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.451822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.452074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.452251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.452824 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.452911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.452996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453079 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453241 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453385 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453627 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453768 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.453859 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.454473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.454587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.454671 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.454761 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.454841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.454923 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.457968 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.458151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.458320 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.458485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.458651 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.458828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.459038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.459201 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.459373 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.459600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.459823 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.460069 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.460326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.460574 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.460835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.461096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.461353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.461611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.461885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.462214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.462918 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.463199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.463442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.463702 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.463897 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.464155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.464736 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.464972 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.465241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.465655 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.465940 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.466250 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.466492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.467863 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.468157 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.468436 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.468683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.468940 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.469164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.469337 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.469602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.469912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.469912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.470694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.470962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.471353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.471618 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.471618 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.471972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.471972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.472290 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.472457 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.472630 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.473117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.473290 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.473446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.473620 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.475725 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.475913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.476081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.476081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.476391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.476554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.476726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.476883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.477061 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.477226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.477384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.477547 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.477731 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.477887 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.478049 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.478212 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.478367 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.478535 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.478734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.478902 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.479102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.479258 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.479430 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.479678 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.479678 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.480009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.480176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.480332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.480486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.480651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.480814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.481574 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.481779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.481935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.482103 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.482349 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.483559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.483840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.483840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.483840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.483840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.484876 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.485642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.485939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.486112 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.486286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.486444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.486599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.486599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.486958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.487150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.487150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.487469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.487630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.487793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.487956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.488111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.488278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.488433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.488586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.488586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.488885 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.488885 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.489201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.489362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.489517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.489827 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490422 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.490889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.491682 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.491836 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.492004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.492173 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.492328 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.492481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.492642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.492796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.493002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.493170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.493685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.494439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.494611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.494775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.494947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.495141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.495426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.495736 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.495992 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.496379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.496379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.496379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.497076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.497246 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.497246 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.497550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.497550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.497934 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.498717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.498950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.499305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.499584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.499764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.499929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.500093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.500248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.500433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.500708 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.500876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.501049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.501269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.501429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.501586 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.501774 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.501774 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.502210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.502379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.502551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.502551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.503036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.503223 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.503380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.503871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.504042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.504042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.504352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.504352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.504668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.504668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.504962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.505142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.505323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.505596 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.505759 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.505923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.506095 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.506474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.506638 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.506638 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.507133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.507293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.507456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.507698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.507867 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.508048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.508204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.508359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.508518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.508683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.508840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.508994 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.509147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.509301 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.509469 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.509632 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.509795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.509959 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.510132 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.510288 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.510452 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.511318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.511489 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.511670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.511827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.511990 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.512145 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.512308 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.512473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.512642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.512797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.512951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.513106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.513267 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.513432 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.514477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.514732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.515084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.515352 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.515531 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.515826 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.515989 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.516171 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.516329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.516755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.516936 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.517242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.517405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.517569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.517732 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.517894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.518064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.518229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.518394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.518548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.518716 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.518870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.519168 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.519329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.519492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.519492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.519813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.519969 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.520138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.520138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.520444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.520607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.520607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.520923 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.521094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.521094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.521417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.521581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.521735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.521903 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.521903 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.522676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.523912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.525586 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.525749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.526040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.526210 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.526210 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.527059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528449 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528865 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.528865 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.529049 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.529155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.529337 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.529432 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.529432 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.530358 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.530524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.530524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.530798 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.530946 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531146 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531322 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531928 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.531928 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532414 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532549 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.532962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.533107 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.533250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.533395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.533616 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.533616 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.533889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.534069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.534207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.534339 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.534456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.535040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.535040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.538382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.538382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.538684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.538851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.539032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.539208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.539358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.539517 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.539683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.539683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.539979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.540123 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.540279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.540435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.540435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.540721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.540880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541469 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541653 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.541889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542230 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542308 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.542891 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543166 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543879 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.543879 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544321 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544526 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.544728 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.545753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.545753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.545967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546377 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546377 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546543 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546736 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546823 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.546823 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.547511 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.547655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.547816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.547909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.547996 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548202 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.548924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549101 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549797 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549884 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.549979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550123 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550209 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550292 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550599 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.550901 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551845 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.552001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.552001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.552336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.552500 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.552677 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.552844 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.552844 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.553155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.553310 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.553473 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.553628 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.553856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.554104 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.554272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.554435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.554435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.554739 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.554905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.555110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.555270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.555270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.555585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.556125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.556125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.556453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.556611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.556772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.556934 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.556934 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.557297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.557515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.557667 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.557784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.557912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558166 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.558898 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.561104 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.561300 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.561300 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.561560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.561741 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.561741 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562072 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.562506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.563958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564252 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564627 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564725 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.564914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565667 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565869 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.565959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566499 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.566937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567406 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.567963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568056 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568425 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568512 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568769 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568869 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.568964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569057 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569244 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569342 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569418 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569673 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569673 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.569959 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570604 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.570944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571158 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571234 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571671 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.571926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572109 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572580 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.572974 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573054 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573139 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.573767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574361 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574540 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.574637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575320 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.575928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.576645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.576730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.576811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577690 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.577945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578406 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.578827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579491 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579627 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579728 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579809 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.579969 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580057 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580057 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580266 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580630 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580723 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.580905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581006 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581530 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581624 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581717 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581803 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581876 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.581969 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582056 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582406 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582487 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582640 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582892 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.582997 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.583075 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.583296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.583436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.583552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.583683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.583810 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.583927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584161 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584403 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584806 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.584905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585159 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585244 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585522 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585865 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.585964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586137 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586230 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586598 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.586958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587202 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587357 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587574 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.587940 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588223 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588317 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588412 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588677 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.588939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589379 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=151551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.589805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.590577 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.595619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.596928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.597422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.597422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.597422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.597422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.597422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.597422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.597822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.598249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.598824 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.599414 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.599959 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.600381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.601257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.601257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.601461 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.601744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.602075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.602406 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.602786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.603192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.603444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.606963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.607967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.607967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.607967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.607967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.607967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.608780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.608780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.608938 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.609226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.609541 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.609856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.610180 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.610550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.610813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.611176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.611502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.611813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.612143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.612478 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.613026 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.613382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.613709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.614043 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.614380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.614703 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.615040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.615375 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.615699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.616007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.616338 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.616656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.617094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.617333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.617658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.617984 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.618297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.618617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.618930 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.619295 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.619611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.619925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.620325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.620722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.620957 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.621272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.621590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.621900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.622227 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.622545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.622902 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.623279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.623600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.623963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.624294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.624596 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.624935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.625252 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.625566 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.625896 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.626222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.626556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.626878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.627244 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.627610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.627939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.628536 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.628883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.629218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.629574 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.629921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.630239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.630556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.630884 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.631230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.631557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.631887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.632206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.632594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.632848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.633169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.633553 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.633809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.634164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.634485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.634807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.635162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.635484 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.635805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.636130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.636484 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.636815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.637142 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.637469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.637803 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.638207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.638436 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641942 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.641942 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.642248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.642583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.642911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.643275 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.643668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.643926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.644260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.644581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.644919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.647889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.647889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.647889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.647889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.647889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.647889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.647889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.648518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO dbcounter [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Registered counter for database nova_api Sep 07 13:31:39.649339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.649339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.649339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.649339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.649339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.649339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.650064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.650064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.650064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.650381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.650666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.651000 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.651335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.651640 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.651952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.652266 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.652586 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.652907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.653220 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.653626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.653844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.654156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.655095 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.655438 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.655767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.656099 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.656421 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.656752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.657076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.657411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.657742 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.658077 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.658470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.659007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.659342 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.659669 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.659997 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.660435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.660765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.661089 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.661433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.661760 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.662071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.662410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.662735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.663092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.663426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.663754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.664091 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.664413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.664738 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.665057 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.665377 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.665700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.666031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.666358 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.667551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.667551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.667551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.668413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.668413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.668413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.671053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.672499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:31:39.672499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=151552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:31:39.675681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_db.sqlalchemy.engines [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:39.684918 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writer thread running {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:39.747176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.context [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6(cell1) {{(pid=151551) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:31:39.753025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:39.753320 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:39.755397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:39.756287 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:39.756772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:39.759127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:39.761338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO dbcounter [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Registered counter for database nova_cell0 Sep 07 13:31:39.768013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO dbcounter [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Registered counter for database nova_cell1 Sep 07 13:31:39.777888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_db.sqlalchemy.engines [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:39.779543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_db.sqlalchemy.engines [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:39.788623 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writer thread running {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:39.791486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writer thread running {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:39.832616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO dbcounter [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Registered counter for database nova_api Sep 07 13:31:39.868604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_db.sqlalchemy.engines [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:39.868604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writer thread running {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:39.946477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.context [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6(cell1) {{(pid=151552) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:31:39.949570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO dbcounter [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Registered counter for database nova_cell0 Sep 07 13:31:39.955207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:39.956116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:39.958061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_db.sqlalchemy.engines [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:39.959697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:39.961144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:39.962017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:39.964184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writer thread running {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:39.966226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:39.970252 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO dbcounter [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Registered counter for database nova_cell0 Sep 07 13:31:39.978268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO dbcounter [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Registered counter for database nova_cell1 Sep 07 13:31:39.988684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_db.sqlalchemy.engines [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:39.992278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_db.sqlalchemy.engines [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:39.994016 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writer thread running {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:40.143935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writer thread running {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:40.153493 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO dbcounter [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Registered counter for database nova_cell0 Sep 07 13:31:40.162715 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_db.sqlalchemy.engines [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=151552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:31:40.174726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writer thread running {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:31:40.303290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: WARNING keystonemiddleware.auth_token [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:31:40.311375 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: WARNING keystonemiddleware.auth_token [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:31:40.542559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: WARNING keystonemiddleware.auth_token [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:31:40.551041 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: WARNING keystonemiddleware.auth_token [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:31:40.677431 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: WARNING keystonemiddleware.auth_token [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:31:40.683807 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: WARNING keystonemiddleware.auth_token [None req-d27e639c-c764-45e7-8e58-36d4ebafd36f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:31:40.690297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bde570d9c0 pid: 151551 (default app) Sep 07 13:31:40.943345 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: WARNING keystonemiddleware.auth_token [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:31:40.950405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: WARNING keystonemiddleware.auth_token [None req-3c3354db-532b-4adf-9e0f-5b389706cd1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:31:40.958313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bde570d9c0 pid: 151552 (default app) Sep 07 13:32:23.928301 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=3 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:23.931977 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=3 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:23.933578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=3 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:23.935826 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=3 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:25.669147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0c46e7cf-4f1b-4021-ab16-1a64332c5523 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Action: 'create', calling method: .version_select at 0x7f174cdb7430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-592834937", "metadata": {"Type": "work"}}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0c46e7cf-4f1b-4021-ab16-1a64332c5523 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Request method failure captured: Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 121 Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ1n9aIo6nrVf_N2KXSwi4cSspyNeFYuhMN6m-zAMZgQBMGWzX0dHY1IF1aFM_Wc9YNSb876u6uxsOxomvKx5Aabll9rJceRL3ERYuUQ69IC1gQUHoI2LzNLAiaGoaK1ncu6faENyQpG1N506DRkHbyvdFB0Z-vKqk7l-7PZZgT-goM Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:32:25.680007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_28c787bb7f894a8d950d27a50f1f6284", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: a93907c2bdc84d39a331747fffa8b6a8 Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-592834937", "metadata": {"Type": "work"}}} Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: Sep 07 13:32:25.681169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-592834937', 'metadata': {'Type': 'work'}}}} Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:32:25.681959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:32:25.683163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:32:25.684185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:32:25.684185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:25.684185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0c46e7cf-4f1b-4021-ab16-1a64332c5523 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:32:25.684185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0c46e7cf-4f1b-4021-ab16-1a64332c5523 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.782964 Sep 07 13:32:25.686359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 7 13:32:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1790 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:32:26.253496 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5883f663-2003-4659-a434-eef551740d4f tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Action: 'create', calling method: .version_select at 0x7f174ce9a3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1756768646", "metadata": {"Type": "work"}}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5883f663-2003-4659-a434-eef551740d4f tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Request method failure captured: Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 120 Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ1n9aIo6nrVf_N2KXSwi4cSspyNeFYuhMN6m-zAMZgQBMGWzX0dHY1IF1aFM_Wc9YNSb876u6uxsOxomvKx5Aabll9rJceRL3ERYuUQ69IC1gQUHoI2LzNLAiaGoaK1ncu6faENyQpG1N506DRkHbyvdFB0Z-vKqk7l-7PZZgT-goM Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:32:26.270612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_28c787bb7f894a8d950d27a50f1f6284", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: a93907c2bdc84d39a331747fffa8b6a8 Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1756768646", "metadata": {"Type": "work"}}} Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: Sep 07 13:32:26.272602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1756768646', 'metadata': {'Type': 'work'}}}} Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi '0' Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:32:26.274313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:32:26.276466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:32:26.279327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:32:26.279327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.279327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5883f663-2003-4659-a434-eef551740d4f tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:32:26.279327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5883f663-2003-4659-a434-eef551740d4f tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.572918 Sep 07 13:32:26.279327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 1/2] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 7 13:32:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 577 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:32:26.287622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a322bb50-09cb-4f77-9cce-787cc1e194f8 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Action: 'create', calling method: .version_select at 0x7f174cdb7d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1309415951", "metadata": {"Type": "work"}}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a322bb50-09cb-4f77-9cce-787cc1e194f8 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Request method failure captured: Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 119 Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ1n9aIo6nrVf_N2KXSwi4cSspyNeFYuhMN6m-zAMZgQBMGWzX0dHY1IF1aFM_Wc9YNSb876u6uxsOxomvKx5Aabll9rJceRL3ERYuUQ69IC1gQUHoI2LzNLAiaGoaK1ncu6faENyQpG1N506DRkHbyvdFB0Z-vKqk7l-7PZZgT-goM Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:32:26.292381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_28c787bb7f894a8d950d27a50f1f6284", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: a93907c2bdc84d39a331747fffa8b6a8 Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1309415951", "metadata": {"Type": "work"}}} Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: Sep 07 13:32:26.295533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1309415951', 'metadata': {'Type': 'work'}}}} Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi '' Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:32:26.297293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:32:26.299655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:32:26.301635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:32:26.301635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:26.301635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a322bb50-09cb-4f77-9cce-787cc1e194f8 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:32:26.301635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a322bb50-09cb-4f77-9cce-787cc1e194f8 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010324 Sep 07 13:32:26.302590 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 7 13:32:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:32:26.309266 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=3 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:26.312482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=3 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:26.319213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=3 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:26.327107 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=3 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:26.336695 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6ec7f43e-4242-4bdd-bae2-03e38763bbc1 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Calling method '.version_select at 0x7f174cd92790>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:27.148309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-6ec7f43e-4242-4bdd-bae2-03e38763bbc1 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] HTTP exception thrown: Volume tempest-invalid-1887474960 could not be found. Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6ec7f43e-4242-4bdd-bae2-03e38763bbc1 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Request method failure captured: Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1887474960 HTTP/1.1 Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ1n9aIo6nrVf_N2KXSwi4cSspyNeFYuhMN6m-zAMZgQBMGWzX0dHY1IF1aFM_Wc9YNSb876u6uxsOxomvKx5Aabll9rJceRL3ERYuUQ69IC1gQUHoI2LzNLAiaGoaK1ncu6faENyQpG1N506DRkHbyvdFB0Z-vKqk7l-7PZZgT-goM Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:32:27.154350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_28c787bb7f894a8d950d27a50f1f6284", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: a93907c2bdc84d39a331747fffa8b6a8 Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Volume tempest-invalid-1887474960 could not be found. Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': 'tempest-invalid-1887474960'} Sep 07 13:32:27.155464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1887474960 could not be found. (HTTP 404) (Request-ID: req-c30576bd-8c75-4689-9a6a-781124c2fa76) Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.156068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:32:27.157020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1887474960 could not be found. Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:32:27.157987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1887474960 could not be found. Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1887474960 could not be found. Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6ec7f43e-4242-4bdd-bae2-03e38763bbc1 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Returning 404 to user: Volume tempest-invalid-1887474960 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:32:27.159155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6ec7f43e-4242-4bdd-bae2-03e38763bbc1 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1887474960" status: 404 len: 99 microversion: 2.1 time: 0.851654 Sep 07 13:32:27.161354 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:32:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1887474960 => generated 99 bytes in 857 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:32:27.170867 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5f6d4add-7297-4a6b-8a7f-7a1e5d259a0a tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005246 Sep 07 13:32:27.172365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 3/5] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Sep 7 13:32:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 07 13:32:27.204450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-150e75c9-8b97-478e-8acb-7fc5c5abf1d7 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.023102 Sep 07 13:32:27.209844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 3/6] 10.222.0.62 () {58 vars in 1137 bytes} [Wed Sep 7 13:32:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 13:32:27.217797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2e6aabef-c6b7-4a01-af2c-d127ac214e8a tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Calling method '.version_select at 0x7f174cc793a0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:27.602464 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-2e6aabef-c6b7-4a01-af2c-d127ac214e8a tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] HTTP exception thrown: Volume eb10237f-de5b-4d8e-ac69-81c21f9da851 could not be found. Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2e6aabef-c6b7-4a01-af2c-d127ac214e8a tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Request method failure captured: Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/os-volumes/eb10237f-de5b-4d8e-ac69-81c21f9da851 HTTP/1.1 Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ1n9aIo6nrVf_N2KXSwi4cSspyNeFYuhMN6m-zAMZgQBMGWzX0dHY1IF1aFM_Wc9YNSb876u6uxsOxomvKx5Aabll9rJceRL3ERYuUQ69IC1gQUHoI2LzNLAiaGoaK1ncu6faENyQpG1N506DRkHbyvdFB0Z-vKqk7l-7PZZgT-goM Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:32:27.607576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_28c787bb7f894a8d950d27a50f1f6284", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: a93907c2bdc84d39a331747fffa8b6a8 Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Volume eb10237f-de5b-4d8e-ac69-81c21f9da851 could not be found. Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': 'eb10237f-de5b-4d8e-ac69-81c21f9da851'} Sep 07 13:32:27.608695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb10237f-de5b-4d8e-ac69-81c21f9da851 could not be found. (HTTP 404) (Request-ID: req-9ef33601-cb98-4385-baf1-0ea5514dce91) Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.609504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:32:27.610381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb10237f-de5b-4d8e-ac69-81c21f9da851 could not be found. Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:32:27.611296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb10237f-de5b-4d8e-ac69-81c21f9da851 could not be found. Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb10237f-de5b-4d8e-ac69-81c21f9da851 could not be found. Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2e6aabef-c6b7-4a01-af2c-d127ac214e8a tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Returning 404 to user: Volume eb10237f-de5b-4d8e-ac69-81c21f9da851 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:32:27.612447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2e6aabef-c6b7-4a01-af2c-d127ac214e8a tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/eb10237f-de5b-4d8e-ac69-81c21f9da851" status: 404 len: 109 microversion: 2.1 time: 0.398089 Sep 07 13:32:27.615688 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:32:27 2022] DELETE /compute/v2.1/os-volumes/eb10237f-de5b-4d8e-ac69-81c21f9da851 => generated 109 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:32:27.629366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-79f9e596-935d-4555-9e50-b7ee1d6afa55 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Calling method '.version_select at 0x7f174cbdb160>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:27.722180 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-79f9e596-935d-4555-9e50-b7ee1d6afa55 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] HTTP exception thrown: Volume 7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 could not be found. Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-79f9e596-935d-4555-9e50-b7ee1d6afa55 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Request method failure captured: Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/os-volumes/7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 HTTP/1.1 Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ1n9aIo6nrVf_N2KXSwi4cSspyNeFYuhMN6m-zAMZgQBMGWzX0dHY1IF1aFM_Wc9YNSb876u6uxsOxomvKx5Aabll9rJceRL3ERYuUQ69IC1gQUHoI2LzNLAiaGoaK1ncu6faENyQpG1N506DRkHbyvdFB0Z-vKqk7l-7PZZgT-goM Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:32:27.726932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/28c787bb7f894a8d950d27a50f1f6284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_28c787bb7f894a8d950d27a50f1f6284", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 28c787bb7f894a8d950d27a50f1f6284 Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-VolumesNegativeTest-934302737 Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: a93907c2bdc84d39a331747fffa8b6a8 Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-VolumesNegativeTest-934302737-project Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Volume 7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 could not be found. Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '7caf1db9-9dfc-4f66-9cb2-f88bacd376c6'} Sep 07 13:32:27.729127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 could not be found. (HTTP 404) (Request-ID: req-6d31b57f-8f04-42f8-ac86-e79181e36d93) Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.730518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:32:27.733256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 could not be found. Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:32:27.739100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 could not be found. Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 could not be found. Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-79f9e596-935d-4555-9e50-b7ee1d6afa55 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] Returning 404 to user: Volume 7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:32:27.743452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-79f9e596-935d-4555-9e50-b7ee1d6afa55 tempest-VolumesNegativeTest-934302737 tempest-VolumesNegativeTest-934302737-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7caf1db9-9dfc-4f66-9cb2-f88bacd376c6" status: 404 len: 109 microversion: 2.1 time: 0.118648 Sep 07 13:32:27.748558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:32:27 2022] GET /compute/v2.1/os-volumes/7caf1db9-9dfc-4f66-9cb2-f88bacd376c6 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:32:44.851379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1986061369", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:45.247894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] validate_networks() for [('3e5113d0-24ef-406d-8c1a-7899200f3372', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:32:48.716770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:32:48.719668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:32:48.721001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:32:48.721982 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:32:48.723338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:32:48.778224 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:48.783758 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:48.785226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:48.791447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:48.792164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:48.792813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:48.914150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:32:48.938355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for user a145e63a44db43acafc92bb2a238f463 and project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:32:48.995273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:32:49.011731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:32:49.496688 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b88d773d-3d45-429e-8c77-18aaa6a78f16 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.137902 Sep 07 13:32:49.513152 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 5/9] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:32:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 5153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:32:49.524788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6d91438f-ad4c-477d-8acd-2c0407c64d7b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:49.526156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6d91438f-ad4c-477d-8acd-2c0407c64d7b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:50.441102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6d91438f-ad4c-477d-8acd-2c0407c64d7b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:50.541489 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6d91438f-ad4c-477d-8acd-2c0407c64d7b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1222 microversion: 2.1 time: 1.023601 Sep 07 13:32:50.547333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 5/10] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:49 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1222 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:51.487740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-404236042", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:51.702178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] validate_networks() for [('3e5113d0-24ef-406d-8c1a-7899200f3372', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:32:53.525783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-63d036b0-d981-4c4c-8399-f6fa30c38fe7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'create', calling method: .version_select at 0x7f174cbabca0>, body: {"keypair": {"name": "tempest-keypair-431850613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcz1DQsXFiulUV6dB+Mxdr8KK7iriZ07nhZ36xf8xOng9+f2uiMrgh0503JW2tPtPi7/BWhzbqEOFXIsY15a2TnDMawd+5HtGJFPgLr2sQMwP4c8jh3rgyTjVrSwdZg9w=="}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:53.664477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-63d036b0-d981-4c4c-8399-f6fa30c38fe7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for project e0e892aa9df049c387360b67c5e2e065. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:32:53.692900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-63d036b0-d981-4c4c-8399-f6fa30c38fe7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for user 7e7db29f64934026abbe96d5cb5baf25 and project e0e892aa9df049c387360b67c5e2e065. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:32:53.959155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-63d036b0-d981-4c4c-8399-f6fa30c38fe7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.311469 Sep 07 13:32:53.967461 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 6/11] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:32:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:32:55.290890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-89993994", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "networks": [{"uuid": "01685aea-1e1f-456d-b167-39fd0b0e56f5"}]}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:55.463227 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] validate_networks() for [('01685aea-1e1f-456d-b167-39fd0b0e56f5', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:32:56.296229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:32:56.297094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:32:56.297819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:32:56.298556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:32:56.305917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:32:56.335097 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.335963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.337120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.338522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.351532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.353680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.455535 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:32:56.491285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for user a145e63a44db43acafc92bb2a238f463 and project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:32:56.577289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:32:56.587767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:32:56.951087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b2636cc3-922d-41de-87e9-ab0456920505 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.469754 Sep 07 13:32:56.967939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 6/12] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:32:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 5488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:32:56.999901 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4b25beb1-cabb-4313-a245-450e4caf4ee5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:57.001122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4b25beb1-cabb-4313-a245-450e4caf4ee5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:57.590386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4b25beb1-cabb-4313-a245-450e4caf4ee5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:57.687421 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4b25beb1-cabb-4313-a245-450e4caf4ee5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1221 microversion: 2.1 time: 0.706731 Sep 07 13:32:57.692877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:56 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1221 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:32:59.175813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3cfd4589-29e1-4e97-b727-d1a498021647 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: .version_select at 0x7f174cd8b280>, body: {"keypair": {"name": "tempest-keypair-709369045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRi/6AIfm8JDZ85OVZeL8Qj+bV3liaqgMUpATAHQLuLeHNQMdDKewp4V466N9JfPLtmrZrUmaISocTsDDnPqzmfRvBbVd/USN7FDrngHo97uUFuUPL/0/25XYs48IMXnQ=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:59.370204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3cfd4589-29e1-4e97-b727-d1a498021647 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:32:59.387600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3cfd4589-29e1-4e97-b727-d1a498021647 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:32:59.644268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3cfd4589-29e1-4e97-b727-d1a498021647 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.949455 Sep 07 13:32:59.644891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 8/14] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:32:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:32:59.660548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-572d382b-3260-41ab-9aad-548546b8326d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:59.661183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-572d382b-3260-41ab-9aad-548546b8326d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:00.078672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-572d382b-3260-41ab-9aad-548546b8326d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:00.096352 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-572d382b-3260-41ab-9aad-548546b8326d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1221 microversion: 2.1 time: 0.439712 Sep 07 13:33:00.100718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 9/15] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:59 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1221 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:01.147964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:01.156825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:01.179265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:01.180775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:01.184098 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:01.196289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:01.197465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:01.206216 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:02.009982 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:02.071827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-76273f5c-ad2a-497a-a3c2-1d79c8e62c17 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1225 microversion: 2.1 time: 0.930996 Sep 07 13:33:02.072854 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 10/16] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:01 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1225 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:03.114014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:03.116630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:03.172811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:03.189805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:03.198140 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:03.238284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:03.244635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:03.249608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:03.350727 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:33:03.351698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:33:03.352610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:33:03.353362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:33:03.354136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:33:03.403545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:03.403545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:03.403545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:03.408038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:03.409007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:03.409819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:03.509846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Getting quotas for project 5db02cd9acdc4dc9b42a6b1ee5cc2f23. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:33:03.538827 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Getting quotas for user 80341b19855e496b96b2948b916db613 and project 5db02cd9acdc4dc9b42a6b1ee5cc2f23. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:33:03.632356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:33:03.646764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:33:04.051389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:04.073175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e5df838b-8243-4277-9319-fb7bfcd05991 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.346879 Sep 07 13:33:04.090741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 7/17] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:32:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 9372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:33:04.118896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8d363739-7ad8-4de6-bcf6-509d8ec12ef2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1273 microversion: 2.1 time: 1.016253 Sep 07 13:33:04.123217 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 11/18] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:03 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1273 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:04.130468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9aabea5c-90e4-43a1-bc14-07e26ec87dbc tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:04.130468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9aabea5c-90e4-43a1-bc14-07e26ec87dbc tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:05.166726 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:05.167978 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:05.177619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9aabea5c-90e4-43a1-bc14-07e26ec87dbc tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:05.209926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:05.210666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9aabea5c-90e4-43a1-bc14-07e26ec87dbc tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1213 microversion: 2.1 time: 1.100184 Sep 07 13:33:05.216534 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 8/19] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:04 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1213 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:05.235209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:05.235693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:05.247347 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:05.250779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:05.251731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:06.255615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ffb362f0-c0cf-4e89-a801-640a1e55a889 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:06.271521 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ffb362f0-c0cf-4e89-a801-640a1e55a889 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:06.392332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=4 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:06.622518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ffb362f0-c0cf-4e89-a801-640a1e55a889 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:06.650802 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ffb362f0-c0cf-4e89-a801-640a1e55a889 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1213 microversion: 2.1 time: 0.403204 Sep 07 13:33:06.655563 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 9/20] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:06 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1213 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:06.786035 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:06.830014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-af6d505e-2f51-43c8-9165-ec81cc118524 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1291 microversion: 2.1 time: 1.661197 Sep 07 13:33:06.843005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 12/21] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:05 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1291 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:07.698206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:07.701746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:07.729821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:07.738500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:07.739992 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:07.744576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:07.747802 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:07.749648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:07.896933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:07.898814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:07.965692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:07.968053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:07.969656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:07.973875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:07.975214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:07.977860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:08.558955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:08.607821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-69ab96b1-7bea-4f94-806d-492554156ba5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1279 microversion: 2.1 time: 0.739836 Sep 07 13:33:08.617191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 13/22] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:07 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1279 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:08.767531 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:08.796714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-908e6795-ed9d-4f5d-9f9b-1ca7e396926f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1217 microversion: 2.1 time: 1.115670 Sep 07 13:33:08.820374 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 10/23] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:07 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1217 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:09.665791 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:09.666878 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:09.718117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:09.729023 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:09.731179 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:09.739353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:09.741287 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:09.743902 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:09.845719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:09.854878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:09.906863 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:09.920247 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:09.926430 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:09.928846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:09.940384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:09.944668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:10.084780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=20 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:10.394339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:10.436173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-86fee12e-2fc9-4013-a8ac-147da3fc0d78 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1265 microversion: 2.1 time: 0.601415 Sep 07 13:33:10.449127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 11/24] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:09 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1265 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:10.730585 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:10.755896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-68d49fe3-c6e7-4df2-8d03-3a5c9cc6ff90 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1279 microversion: 2.1 time: 1.098906 Sep 07 13:33:10.767370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 14/25] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:09 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1279 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:11.505939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:11.512849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:11.562967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:11.572168 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:11.572965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:11.582144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:11.584711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:11.587608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:11.818297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:11.819421 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:11.858424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:11.865556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:11.866601 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:11.874154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:11.880693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:11.886505 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:12.393929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:12.417126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-aaa13a33-cbc1-4566-9c4b-beb0e93afd09 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1279 microversion: 2.1 time: 0.604267 Sep 07 13:33:12.421476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 15/26] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:11 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1279 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:12.680790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:12.737757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9b803321-fc88-4f23-badb-ab9970188dbf tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1271 microversion: 2.1 time: 1.257087 Sep 07 13:33:12.743477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 12/27] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:11 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1271 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:13.485216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:13.489671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:13.515617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:13.524858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:13.529084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:13.531472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:13.534325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:13.537767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:13.539972 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:13.637652 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ba6c26af-c1da-4580-a338-375e37e508e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'create', calling method: .version_select at 0x7f174c1653a0>, body: {"keypair": {"name": "tempest-keypair-1927169514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC33wFri3+ZG2QJMLEQj+yBvMoQEIyHUGgxL5B/8yD8CwOahlDKVYUwd2b5JwSdKwsNmPkOHZUmmQKKcWEajcF+Y1xIn22YYGu0Oqmy8BfoFdSq1+bw/8Og6b9r8ZV+yA=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:13.733630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-ba6c26af-c1da-4580-a338-375e37e508e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:33:13.743046 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-ba6c26af-c1da-4580-a338-375e37e508e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for user 32401931d75649018f6b0e55144bb5f2 and project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:33:13.971427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ba6c26af-c1da-4580-a338-375e37e508e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.341433 Sep 07 13:33:13.972715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 16/28] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Sep 7 13:33:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1345 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 07 13:33:13.981856 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:13.997052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:14.030883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:14.041389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:14.046928 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:14.051833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:14.063386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:14.067548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:14.459826 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:14.473992 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fcfca219-7a10-40ef-8234-db10236afca2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.999562 Sep 07 13:33:14.475973 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 13/29] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:13 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:14.494126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1296754816", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10b9a5d0-4fa4-4810-92ba-bac4e37bdfcf"}], "security_groups": [{"name": "tempest-securitygroup--972511713"}], "key_name": "tempest-keypair-431850613", "user_data": "}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:14.903952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:14.907021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=45 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:14.918401 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8729fe25-869e-49bd-ba73-1756e8b7f534 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1271 microversion: 2.1 time: 0.943690 Sep 07 13:33:14.919634 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 17/30] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:13 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1271 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:14.981795 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] validate_networks() for [('10b9a5d0-4fa4-4810-92ba-bac4e37bdfcf', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:33:15.527937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:15.528976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:15.548634 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:15.564569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:15.576434 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:15.582122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:15.587279 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:15.587279 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:15.587279 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:16.651749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=16 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:17.516006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:17.550235 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2aa0b93d-9922-4619-9c69-15d0a21cb924 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 2.027620 Sep 07 13:33:17.554020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 18/31] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:15 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:17.584099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:17.588887 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:17.638684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:17.639436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:17.639907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:17.644971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:17.645733 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:17.646247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:17.738217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:33:17.739144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:33:17.739144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:33:17.740289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:33:17.740289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:33:17.792007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:17.792007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:17.792007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:17.792007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:17.792617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:17.792617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:17.921000 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for project e0e892aa9df049c387360b67c5e2e065. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:33:17.937078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for user 7e7db29f64934026abbe96d5cb5baf25 and project e0e892aa9df049c387360b67c5e2e065. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:33:17.974332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:33:17.982272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:33:18.308745 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-aa0fe2ec-c250-4ad6-9cbb-a064599be155 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.831048 Sep 07 13:33:18.316839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 14/32] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:33:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 3840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:33:18.338157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1139776089", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834c0-0dea-41cd-83a3-dc66b7dd2f54"}], "security_groups": [{"name": "tempest-securitygroup--833320009"}], "key_name": "tempest-keypair-709369045", "user_data": "}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:19.050233 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:19.087184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ab2af20d-4583-4788-81bd-df2a100f621c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 1.522939 Sep 07 13:33:19.127886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 19/33] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:17 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:19.145500 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1433a7cf-4733-40d2-b1b5-5d67882a88de tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:19.145500 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1433a7cf-4733-40d2-b1b5-5d67882a88de tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:19.290609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] validate_networks() for [('6b6834c0-0dea-41cd-83a3-dc66b7dd2f54', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:33:19.702414 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1433a7cf-4733-40d2-b1b5-5d67882a88de tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:19.721627 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1433a7cf-4733-40d2-b1b5-5d67882a88de tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1237 microversion: 2.1 time: 0.590856 Sep 07 13:33:19.725818 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 20/34] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:19 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1237 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:19.735428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:19.737447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:19.756450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:19.760723 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:19.767066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:19.773430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:19.776479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:19.780207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:20.387121 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:21.474473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:21.500392 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bb590651-6f72-42eb-9d19-510dac24430e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 1.771945 Sep 07 13:33:21.506158 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 21/35] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:19 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:21.567318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:21.572065 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:21.657798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:21.659459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:21.660601 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:21.679595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:21.680933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:21.686178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:21.953619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:33:21.954824 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:33:21.956026 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:33:21.958054 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:33:21.966338 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:33:22.028710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:22.030199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:22.033964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:22.046666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:22.048349 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:22.053329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:22.114784 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:33:22.125449 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:33:22.161549 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:33:22.167100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:33:22.660508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e050023b-8949-4d9c-a9c6-e724a87b25dd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.341535 Sep 07 13:33:22.663412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 15/36] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:33:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 4346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:33:22.684779 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:22.687922 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:22.754300 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:22.759969 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:22.765275 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:22.776509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:22.780615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:22.781393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:23.325642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:23.383174 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-87ef7edc-8c8a-46bb-a4f3-70336acf6d2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1289 microversion: 2.1 time: 0.715852 Sep 07 13:33:23.390790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 16/37] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:22 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1289 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:23.452329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:23.458030 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:23.522289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:23.534189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:23.540101 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:23.541732 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:23.546934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:23.555587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:23.775937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:23.819557 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d0633f19-cf40-4895-8df1-1cc601db91ce tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 2.310967 Sep 07 13:33:23.828329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 22/38] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:21 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:23.852411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6646e9a1-4130-4fbc-b3c4-8b3f63ff08cc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:23.859335 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6646e9a1-4130-4fbc-b3c4-8b3f63ff08cc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:24.334296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:24.350611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1b9a6eff-d619-448e-a07a-1831b4a1fb8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.952870 Sep 07 13:33:24.353092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 17/39] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:23 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:24.420597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:24.438445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:24.477122 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:24.477956 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:24.478646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:24.480364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:24.481070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:24.503075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:24.908372 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:24.920907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dd39f811-5795-4a1b-8798-b21f4b7263a9 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1297 microversion: 2.1 time: 0.509388 Sep 07 13:33:24.941645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 18/40] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:24 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1297 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:24.949527 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:24.950648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:24.966122 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:24.967633 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:24.969779 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:24.970789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:24.973456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:24.974682 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:25.392588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6646e9a1-4130-4fbc-b3c4-8b3f63ff08cc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:25.435644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6646e9a1-4130-4fbc-b3c4-8b3f63ff08cc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1241 microversion: 2.1 time: 1.603122 Sep 07 13:33:25.441204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 23/41] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:23 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1241 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:25.469318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:25.482245 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:25.521623 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:25.529268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:25.539570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:25.542171 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:25.548293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:25.549308 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:26.275575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:26.293367 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-eec52eff-85c5-47b2-a117-faea4f10a501 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.850845 Sep 07 13:33:26.293960 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 24/42] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:25 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:26.360732 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:26.389570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d9ca282f-9164-4092-af00-8655327cfefe tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 1.446088 Sep 07 13:33:26.390613 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 19/43] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:24 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:26.576520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-5f1352d9-fb74-4286-98e3-3d0f28be860a req-708680f7-8f5d-49df-999d-c33e07f39a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f676c6-6bfd-4c01-b135-da2507403d9d", "tag": "e3d0ab43-222f-471f-a4a5-9a1851be22ba"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:26.580714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:26.580714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:26.581318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5f1352d9-fb74-4286-98e3-3d0f28be860a req-708680f7-8f5d-49df-999d-c33e07f39a52 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:26.581318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5f1352d9-fb74-4286-98e3-3d0f28be860a req-708680f7-8f5d-49df-999d-c33e07f39a52 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:26.581318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5f1352d9-fb74-4286-98e3-3d0f28be860a req-708680f7-8f5d-49df-999d-c33e07f39a52 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:26.581871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:26.581871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:26.581871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:26.581871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:26.582523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:26.582523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:26.582793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-5f1352d9-fb74-4286-98e3-3d0f28be860a req-708680f7-8f5d-49df-999d-c33e07f39a52 service nova] Creating event network-changed:e3d0ab43-222f-471f-a4a5-9a1851be22ba for instance 72f676c6-6bfd-4c01-b135-da2507403d9d on hv-cinder-85625 Sep 07 13:33:26.582793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5f1352d9-fb74-4286-98e3-3d0f28be860a req-708680f7-8f5d-49df-999d-c33e07f39a52 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=151551) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:33:26.582793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5f1352d9-fb74-4286-98e3-3d0f28be860a req-708680f7-8f5d-49df-999d-c33e07f39a52 service nova] Acquired lock "compute-rpcapi-router" {{(pid=151551) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:33:26.582793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:26.582793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:26.583439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:26.583439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:26.583439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:26.583439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:26.583439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.compute.rpcapi [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:33:26.584051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] Releasing lock "compute-rpcapi-router" {{(pid=151551) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:33:26.600783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9d6b084b-df0f-401f-8c38-f5d24986af34 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305370 Sep 07 13:33:26.602029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 25/44] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:26.609585 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f5d68192-9e38-4966-a467-ea9bb2f3864f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:26.611149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f5d68192-9e38-4966-a467-ea9bb2f3864f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:26.650208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:26.659956 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-17ea2044-de01-46c0-87e4-c4a71869ba22 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1295 microversion: 2.1 time: 0.248966 Sep 07 13:33:26.660568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 20/45] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:26 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1295 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:26.747680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f5d68192-9e38-4966-a467-ea9bb2f3864f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:26.760190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f5d68192-9e38-4966-a467-ea9bb2f3864f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1241 microversion: 2.1 time: 0.156767 Sep 07 13:33:26.762306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 26/46] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:26 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1241 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:27.346298 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:27.346886 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:27.355899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.356912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.357980 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:27.359382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.360150 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.360859 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:27.435333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:27.436058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:27.461700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.462572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.465863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:27.466905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.467722 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.468496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:27.655749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:27.687724 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0ce86391-22e6-411d-8268-3ea5e6123071 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.345806 Sep 07 13:33:27.691568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 21/47] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:27 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:27.709274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:27.710691 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:27.727613 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.729071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.731639 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:27.733776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.735081 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.736143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:27.781892 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:27.790539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7cdac2aa-0250-4562-a991-e1d3280b4a1c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.360498 Sep 07 13:33:27.795659 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 27/48] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:27 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:27.822214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-125751096", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7ddc2a2-a118-4acc-9703-1fd5dd4dc095"}], "security_groups": [{"name": "tempest-securitygroup--1927601816"}], "key_name": "tempest-keypair-1927169514", "user_data": "}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:27.881825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:27.893140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-348fcfd7-7406-443a-832b-11d7b8f5342d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1295 microversion: 2.1 time: 0.199539 Sep 07 13:33:27.901899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 22/49] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:27 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1295 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:27.918437 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:27.920794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:27.942601 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.945628 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.947478 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:27.949524 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:27.950893 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:27.953765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:28.051786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:28.067049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] validate_networks() for [('f7ddc2a2-a118-4acc-9703-1fd5dd4dc095', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:33:28.076002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5fa3aba6-7495-426d-9fa0-6a539850ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1245 microversion: 2.1 time: 0.172208 Sep 07 13:33:28.102659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 23/50] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:27 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1245 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:28.718858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:28.720700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:28.749353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:28.752421 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:28.753571 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:28.759842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:28.765192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:28.766395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:29.451407 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:29.473698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-895141f5-045a-43f1-8ee7-5cc6215315c8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.763012 Sep 07 13:33:29.477467 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 24/51] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:28 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:29.491702 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2ca409-5b36-4b33-8293-98ab05050fb8", "tag": "0af9b480-ae6f-4d62-960c-85881021091d"}, {"name": "network-changed", "server_uuid": "3139a784-1167-480e-88d9-659183c28699", "tag": "15ad3583-f182-4a2a-987d-d62ee7ad2e34"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:29.518789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:29.519536 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:29.520214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:29.544651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=85 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:29.559874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Creating event network-changed:0af9b480-ae6f-4d62-960c-85881021091d for instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 on hv-cinder-85625 Sep 07 13:33:29.560655 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Creating event network-changed:15ad3583-f182-4a2a-987d-d62ee7ad2e34 for instance 3139a784-1167-480e-88d9-659183c28699 on hv-cinder-85625 Sep 07 13:33:29.561713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=151552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:33:29.562488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e2f272e2-1ec5-4435-b8d6-fd6c230ce861 req-27670654-0f2e-49ff-9fdf-e90f7b49e08c service nova] Acquired lock "compute-rpcapi-router" {{(pid=151552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:33:29.563958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:29.565243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:29.565922 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:29.567058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:29.567872 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:29.568796 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:29.583986 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.compute.rpcapi [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:33:29.585554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] Releasing lock "compute-rpcapi-router" {{(pid=151552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:33:29.616707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3916dc8f-ff68-4d50-8071-2b8aa6fedd05 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.136992 Sep 07 13:33:29.618047 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 25/52] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:29.630879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:29.632461 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:29.645587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:29.646444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:29.647261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:29.648620 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:29.649511 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:29.650885 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.077649 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:30.116527 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f0ce8d43-a6e5-45ef-92d0-c6144e7480b3 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.495781 Sep 07 13:33:30.148768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 26/53] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:29 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:30.148768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:30.148768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:30.160235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.161488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.162045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.163627 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.164501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.165148 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.412784 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:30.427730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f1dfa72d-838f-49b9-8a09-3e491ddf6d02 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.301550 Sep 07 13:33:30.429227 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 27/54] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:30 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:30.440176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:30.444068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:30.458263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.459295 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.460480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.462009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.462960 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.464463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.559447 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:30.568649 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-09dba192-70fc-49b1-8676-f76ba95af4f7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1293 microversion: 2.1 time: 0.137540 Sep 07 13:33:30.569361 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 28/55] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:30 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:30.574797 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:30.575456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:30.582262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.582778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.583262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.584388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.584552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.585191 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.646798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:33:30.647907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:33:30.649931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:33:30.650841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:33:30.652354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:33:30.673487 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.674132 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.674672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.675571 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:30.676297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:30.677051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:30.703271 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:33:30.710066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for user 32401931d75649018f6b0e55144bb5f2 and project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:33:30.727999 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:33:30.730795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:33:30.859662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:30.869604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b5dc25e4-2dc6-4cbb-9618-87657c11ca42 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.299248 Sep 07 13:33:30.871345 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 29/56] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:30 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:31.033780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5cc29b86-c3d2-4409-9022-5d5e6d128d32 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.224675 Sep 07 13:33:31.034630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 28/57] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Sep 7 13:33:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 3239 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 13:33:31.048505 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e5f285d7-bff2-4268-8185-e82028953326 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:31.050477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e5f285d7-bff2-4268-8185-e82028953326 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:31.120997 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e5f285d7-bff2-4268-8185-e82028953326 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:31.130032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e5f285d7-bff2-4268-8185-e82028953326 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:31.134718 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e5f285d7-bff2-4268-8185-e82028953326 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:31.138700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e5f285d7-bff2-4268-8185-e82028953326 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1281 microversion: 2.20 time: 0.096236 Sep 07 13:33:31.153027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 30/58] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:31 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:31.177121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:31.178137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:31.188241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.188995 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.189527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.190348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.190915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.191480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.463021 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:31.464420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:31.486926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.491867 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.494373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.497953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.499544 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.500787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.690689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:31.713593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0c7722b8-e03c-435d-bea3-da2a8fe41bd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.538775 Sep 07 13:33:31.720917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 29/59] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:31 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:31.752225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:31.753560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:31.767766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.768911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.769799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.771840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.774054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.775128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:32.051559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:32.078282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ba6b1e02-c072-42c1-933e-82ae270bde4c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1293 microversion: 2.1 time: 0.352975 Sep 07 13:33:32.099025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 30/60] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:31 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1293 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:32.107300 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:32.108954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:32.131427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:32.207888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:32.207888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:32.207888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:32.207888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:32.208723 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:32.209450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:32.209450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1623541b-b363-4e80-acbe-579d614b7bf8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.731403 Sep 07 13:33:32.209450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 31/61] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:31 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:32.209450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e4c342d0-35d2-4cae-b9d9-a874d20a0dc3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:32.210512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e4c342d0-35d2-4cae-b9d9-a874d20a0dc3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:32.366770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e4c342d0-35d2-4cae-b9d9-a874d20a0dc3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:32.380661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e4c342d0-35d2-4cae-b9d9-a874d20a0dc3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:32.383153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e4c342d0-35d2-4cae-b9d9-a874d20a0dc3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:32.385878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e4c342d0-35d2-4cae-b9d9-a874d20a0dc3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1281 microversion: 2.20 time: 0.194694 Sep 07 13:33:32.387114 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:32 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:32.453805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:32.464438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9d905415-a890-46ba-b3e8-ed24ca2138b3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.375233 Sep 07 13:33:32.465408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 31/63] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:32 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:32.758845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:32.760001 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:32.773699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:32.774657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:32.775627 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:32.777748 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:32.778615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:32.779501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.136348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:33.147128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:33.160274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.166750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.167812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.173389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.174160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.174667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.175204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.177533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3d11827c-aa50-4b59-8265-aa20c3de1bc7 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.427309 Sep 07 13:33:33.178470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 33/64] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:32 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:33.250360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:33.251358 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:33.263391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.264074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.264864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.265773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.266612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.267255 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.465765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.483564 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3d76762a-d23d-4530-aae2-98e8fc2cfe18 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.237927 Sep 07 13:33:33.484241 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 34/65] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:33 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:33.489451 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e30f5704-246b-467b-9369-6f52534d69b3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:33.490310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e30f5704-246b-467b-9369-6f52534d69b3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:33.505443 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.516211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-689c6e01-ca0e-482a-a741-55f468e52d83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1301 microversion: 2.1 time: 0.388039 Sep 07 13:33:33.525281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 32/66] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:33 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1301 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:33.537709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:33.539569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:33.549194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.549731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.550481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.551478 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.552072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.552521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.572264 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e30f5704-246b-467b-9369-6f52534d69b3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.583064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e30f5704-246b-467b-9369-6f52534d69b3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.584995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e30f5704-246b-467b-9369-6f52534d69b3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.588566 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e30f5704-246b-467b-9369-6f52534d69b3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1281 microversion: 2.20 time: 0.101286 Sep 07 13:33:33.588566 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 35/67] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:33 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:33.765355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.774541 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e3f71fb7-d660-4bc3-9167-c83b2ea9f37b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.254915 Sep 07 13:33:33.775321 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 33/68] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:33 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:34.060194 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-eeea9ea6-235a-4ec9-9e50-588d8cb6fc84 req-db79bb1b-c3d3-4f7a-9ca8-db85dd40a32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd3d8fa7-7daf-4ceb-9906-985ba2fe332f", "tag": "faac008a-f2a5-4e65-bbd0-203541bb181e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:34.130755 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-eeea9ea6-235a-4ec9-9e50-588d8cb6fc84 req-db79bb1b-c3d3-4f7a-9ca8-db85dd40a32b service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.131286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-eeea9ea6-235a-4ec9-9e50-588d8cb6fc84 req-db79bb1b-c3d3-4f7a-9ca8-db85dd40a32b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.131764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-eeea9ea6-235a-4ec9-9e50-588d8cb6fc84 req-db79bb1b-c3d3-4f7a-9ca8-db85dd40a32b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.179126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-eeea9ea6-235a-4ec9-9e50-588d8cb6fc84 req-db79bb1b-c3d3-4f7a-9ca8-db85dd40a32b service nova] Creating event network-changed:faac008a-f2a5-4e65-bbd0-203541bb181e for instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f on hv-cinder-85625 Sep 07 13:33:34.196658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-eeea9ea6-235a-4ec9-9e50-588d8cb6fc84 req-db79bb1b-c3d3-4f7a-9ca8-db85dd40a32b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144717 Sep 07 13:33:34.199093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 36/69] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:34.208969 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:34.210105 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:34.223731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.231587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.232427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.233895 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.235603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.237027 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.516626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:34.520685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:34.563563 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.566191 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.569321 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.570760 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.574423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.575744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.683630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:34.698588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-38a96ea8-f9c3-4f5a-9d53-7c620cc92d5b tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.497022 Sep 07 13:33:34.699577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 34/70] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:34 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:34.710424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:34.710424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:34.722273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.722782 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.723254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.723963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.724611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.725049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.918035 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:34.933227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bf78a3b3-1918-4ec9-b52c-0a4b7fbc9053 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1311 microversion: 2.1 time: 0.231649 Sep 07 13:33:34.942568 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 35/71] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:34 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1311 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:34.957870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a47ac921-393a-43a2-b186-ac1a433b96ec tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:34.959439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a47ac921-393a-43a2-b186-ac1a433b96ec tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:35.101102 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a47ac921-393a-43a2-b186-ac1a433b96ec tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:35.114263 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a47ac921-393a-43a2-b186-ac1a433b96ec tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:35.116971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a47ac921-393a-43a2-b186-ac1a433b96ec tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:35.118462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a47ac921-393a-43a2-b186-ac1a433b96ec tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1281 microversion: 2.20 time: 0.173775 Sep 07 13:33:35.141260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 36/72] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:34 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:35.163742 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:35.164490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:35.184952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.185525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.186290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.187193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.187689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.188116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.478817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:35.492874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-289c141c-f844-47fe-b11e-d1e2f112ec83 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.981207 Sep 07 13:33:35.494318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 37/73] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:34 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:35.631440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:35.633851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-64ee3a88-1459-45a3-ab45-b96a7f4c88c6 req-08c37851-f2a1-432e-a3b0-c007caf48fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f676c6-6bfd-4c01-b135-da2507403d9d", "name": "network-vif-plugged", "status": "completed", "tag": "e3d0ab43-222f-471f-a4a5-9a1851be22ba"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:35.644072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ae10dfa2-6fe8-467e-8efa-0daf57769aa2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.489776 Sep 07 13:33:35.648641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 37/74] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:35 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:35.653202 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-64ee3a88-1459-45a3-ab45-b96a7f4c88c6 req-08c37851-f2a1-432e-a3b0-c007caf48fd1 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.658260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-64ee3a88-1459-45a3-ab45-b96a7f4c88c6 req-08c37851-f2a1-432e-a3b0-c007caf48fd1 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.684951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-64ee3a88-1459-45a3-ab45-b96a7f4c88c6 req-08c37851-f2a1-432e-a3b0-c007caf48fd1 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.697531 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-64ee3a88-1459-45a3-ab45-b96a7f4c88c6 req-08c37851-f2a1-432e-a3b0-c007caf48fd1 service nova] Creating event network-vif-plugged:e3d0ab43-222f-471f-a4a5-9a1851be22ba for instance 72f676c6-6bfd-4c01-b135-da2507403d9d on hv-cinder-85625 Sep 07 13:33:35.706476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-64ee3a88-1459-45a3-ab45-b96a7f4c88c6 req-08c37851-f2a1-432e-a3b0-c007caf48fd1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208637 Sep 07 13:33:35.707729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 38/75] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:35.723455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:35.726456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:35.734837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.735681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.736316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.737242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.737862 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.738452 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.974871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:35.975952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:35.993962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.998133 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.998608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.999469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.006042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.006888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:36.029634 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:36.046726 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3be02317-2049-4733-961a-624ee0ca21eb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.328133 Sep 07 13:33:36.047912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 38/76] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:35 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:36.163749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:36.164896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:36.188244 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.190244 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.193225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:36.194537 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.195440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.201444 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:36.290484 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=100 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:36.396150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:36.422869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:36.425157 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:36.427291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8b0a4937-7e24-4353-b8aa-083f56a0a46d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1285 microversion: 2.20 time: 0.270908 Sep 07 13:33:36.433471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 39/77] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:36 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:36.528371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:36.535128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:36.556176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.559693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.559693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:36.560282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.561285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.562228 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:36.593015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:36.608171 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-119661e8-f325-492f-8b85-a2bc17b273a4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.650630 Sep 07 13:33:36.635654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 39/78] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:35 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:36.687740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:36.689248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:36.704717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.705834 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.706914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:36.708696 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.709672 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.711104 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.004774 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:37.016827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8bb6e0a9-a4b0-44ee-b1d5-e699f5715ccb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.498740 Sep 07 13:33:37.033264 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 40/79] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:36 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:37.096414 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:37.098746 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:37.112169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:37.113391 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:37.114815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.118259 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:37.119886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:37.121015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.527080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:37.542718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-edba1836-ec42-4726-9518-0fca69910bb8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.458994 Sep 07 13:33:37.543793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 41/80] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:37 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:37.563664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:37.564785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:37.577041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:37.577633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:37.578301 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.579447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:37.580429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:37.582651 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.588286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:37.619340 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9445969a-1880-4736-b475-5c578a420c6a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.931797 Sep 07 13:33:37.619340 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 40/81] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:36 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:37.640979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:37.643459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:37.677179 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:37.678417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:37.679528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.681085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:37.682203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:37.683749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.707442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:37.717195 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:37.718777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:37.727689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-737788f3-0944-4b64-96bf-439746aefe5f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1333 microversion: 2.20 time: 0.174119 Sep 07 13:33:37.728613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 42/82] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:37 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1333 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:37.781348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-9085d5f0-4ee1-4799-9f19-a9e5579a39f6 req-ddd30386-b497-468b-84e9-b5efe73f6ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2ca409-5b36-4b33-8293-98ab05050fb8", "name": "network-vif-plugged", "status": "completed", "tag": "0af9b480-ae6f-4d62-960c-85881021091d"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:37.802024 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-9085d5f0-4ee1-4799-9f19-a9e5579a39f6 req-ddd30386-b497-468b-84e9-b5efe73f6ae5 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:37.811333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-9085d5f0-4ee1-4799-9f19-a9e5579a39f6 req-ddd30386-b497-468b-84e9-b5efe73f6ae5 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:37.816607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-9085d5f0-4ee1-4799-9f19-a9e5579a39f6 req-ddd30386-b497-468b-84e9-b5efe73f6ae5 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.833549 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-9085d5f0-4ee1-4799-9f19-a9e5579a39f6 req-ddd30386-b497-468b-84e9-b5efe73f6ae5 service nova] Creating event network-vif-plugged:0af9b480-ae6f-4d62-960c-85881021091d for instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 on hv-cinder-85625 Sep 07 13:33:37.841333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-9085d5f0-4ee1-4799-9f19-a9e5579a39f6 req-ddd30386-b497-468b-84e9-b5efe73f6ae5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065857 Sep 07 13:33:37.841333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 43/83] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:38.052483 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:38.055112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:38.070559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.072140 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.073614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.074905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.076659 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.077728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.304138 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:38.322464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-409979fd-a2e9-4da9-8f4b-929831b92ddf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.688376 Sep 07 13:33:38.326548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 41/84] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:37 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:38.362631 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:38.383677 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-48976b28-dc98-474a-b8d4-38a3de1a962c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.339981 Sep 07 13:33:38.384947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 44/85] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:38 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:38.583547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:38.585096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:38.596484 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.597310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.598096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.599319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.600072 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.600836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.654940 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:38.657265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:38.663881 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.664386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.664978 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.665728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.666257 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.666916 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.914065 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:38.925327 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-148aad1c-ac5a-40e8-b4d4-3aca30eec975 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.275358 Sep 07 13:33:38.926410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 45/86] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:38 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:38.933383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:38.934230 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:38.943236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.944118 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.945063 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.946008 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.946639 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.947147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.994774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:39.007583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d195d0ac-d017-4511-8c11-0a6265abff47 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.430880 Sep 07 13:33:39.008986 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 42/87] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:38 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:39.061582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:39.073170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:39.080556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:39.082446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-48571422-f859-41ab-b6ce-66845c3f6989 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1333 microversion: 2.20 time: 0.154453 Sep 07 13:33:39.087840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 46/88] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:38 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1333 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:39.357122 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:39.358621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:39.382007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.382709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.383398 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.384311 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.384878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.385486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.423746 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:39.423746 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:39.442543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.446735 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.447490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.448186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.448671 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.449771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.586258 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=6 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:39.748256 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:39.763171 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-46ef0475-bd65-4c00-930d-781b38be6db4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.355184 Sep 07 13:33:39.764443 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 47/89] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:39 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:39.871693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-049fe247-9e80-4aab-9d69-9f5d0cd9b7f1 req-e3ec53d1-a8cd-4cf1-8c0e-c6ea4abd6cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3139a784-1167-480e-88d9-659183c28699", "name": "network-vif-plugged", "status": "completed", "tag": "15ad3583-f182-4a2a-987d-d62ee7ad2e34"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:39.886801 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-049fe247-9e80-4aab-9d69-9f5d0cd9b7f1 req-e3ec53d1-a8cd-4cf1-8c0e-c6ea4abd6cd3 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.887399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-049fe247-9e80-4aab-9d69-9f5d0cd9b7f1 req-e3ec53d1-a8cd-4cf1-8c0e-c6ea4abd6cd3 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.887837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-049fe247-9e80-4aab-9d69-9f5d0cd9b7f1 req-e3ec53d1-a8cd-4cf1-8c0e-c6ea4abd6cd3 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.904236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-049fe247-9e80-4aab-9d69-9f5d0cd9b7f1 req-e3ec53d1-a8cd-4cf1-8c0e-c6ea4abd6cd3 service nova] Creating event network-vif-plugged:15ad3583-f182-4a2a-987d-d62ee7ad2e34 for instance 3139a784-1167-480e-88d9-659183c28699 on hv-cinder-85625 Sep 07 13:33:39.910069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-049fe247-9e80-4aab-9d69-9f5d0cd9b7f1 req-e3ec53d1-a8cd-4cf1-8c0e-c6ea4abd6cd3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044110 Sep 07 13:33:39.910789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 48/90] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:33:39.973569 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:39.985032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d12537b1-f3cc-4359-86aa-7192722b06df tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.635916 Sep 07 13:33:39.986262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 43/91] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:39 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:39.987859 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-4ca679a8-b866-46ca-93ca-add09c1bc563 req-1003a771-263a-4fcc-bb4b-927f791e17b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3f1350-9b24-4671-8770-5bdc7f6921a1", "tag": "06a799cf-4ec2-424a-9ae1-0a28f235a093"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:39.991022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:39.991659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:39.999831 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.000566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4ca679a8-b866-46ca-93ca-add09c1bc563 req-1003a771-263a-4fcc-bb4b-927f791e17b8 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.000658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.007090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4ca679a8-b866-46ca-93ca-add09c1bc563 req-1003a771-263a-4fcc-bb4b-927f791e17b8 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.007254 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.007400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4ca679a8-b866-46ca-93ca-add09c1bc563 req-1003a771-263a-4fcc-bb4b-927f791e17b8 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.007514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.007514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.007514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.034323 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-4ca679a8-b866-46ca-93ca-add09c1bc563 req-1003a771-263a-4fcc-bb4b-927f791e17b8 service nova] Creating event network-changed:06a799cf-4ec2-424a-9ae1-0a28f235a093 for instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 on hv-cinder-85625 Sep 07 13:33:40.043142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-4ca679a8-b866-46ca-93ca-add09c1bc563 req-1003a771-263a-4fcc-bb4b-927f791e17b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129160 Sep 07 13:33:40.044306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 49/92] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:40.052208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:40.053232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:40.063402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.064885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.065404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.066648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.067470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.068455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.234368 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:40.243371 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1b75c076-f701-4624-a6b3-4b934dfa169b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.256191 Sep 07 13:33:40.244360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 44/93] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:39 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:40.250775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:40.251433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:40.259776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.261189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.262352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.263897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.264670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.265058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.361002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:40.363713 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:40.372966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:40.373640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4419a80e-cb50-4e33-b6fd-e190937e89f5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.326979 Sep 07 13:33:40.374364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 50/94] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:40 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:40.375864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:40.377918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f3d76896-8c95-4490-9732-4c03698be22b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1351 microversion: 2.20 time: 0.131207 Sep 07 13:33:40.378505 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 45/95] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:40 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:40.798632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:40.803566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:40.806610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=4 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:40.827068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.827625 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.828719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:40.834872 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:40.838698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:40.839663 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.029603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:41.031075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:41.043859 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.044734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.045669 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.046961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.047757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.048448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.061414 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:41.074965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:41.078959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e574f9ae-5562-4918-b98f-23d90e3a56b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.284050 Sep 07 13:33:41.080196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 51/96] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:40 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:41.271555 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:41.272342 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:41.284803 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.285978 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.289090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.299109 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.303334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.303334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.354819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:41.438089 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3e5aa0be-8ce6-4ddd-bf5a-be9d6c377baf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.408343 Sep 07 13:33:41.439430 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 46/97] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:41 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:41.521806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:41.523097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:41.535981 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.539075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.540492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.544115 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.545752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.547141 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.867442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:41.880720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-56534a9e-0b81-4e2a-aea3-6c604051b72b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1321 microversion: 2.1 time: 0.613823 Sep 07 13:33:41.882285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 52/98] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:41 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:41.893268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:41.894313 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:41.908252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.909540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.910252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.911352 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.912082 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.912914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.966093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:41.979004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:41.987947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:41.991213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5ba4d741-87c9-4415-8c80-c69a2185422c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1339 microversion: 2.20 time: 0.537749 Sep 07 13:33:42.007746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 47/99] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:41 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1339 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:42.141395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:42.157189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:42.170593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.171780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.172983 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:42.174133 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.175002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.176598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:42.429587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:42.464980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c1a37d94-998d-4c7e-8350-84c6dbe12fdb tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1313 microversion: 2.1 time: 0.580687 Sep 07 13:33:42.467064 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 53/100] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:41 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:42.500768 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:42.502424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:42.524731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.543930 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.544964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:42.548276 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.549383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.550379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:42.657062 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:42.670117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-821edfb8-b4f6-4e54-959d-021eed9dafaf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.552168 Sep 07 13:33:42.671541 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 48/101] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:42 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:42.912405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:42.917502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:42.944021 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.945899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.946700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:42.949808 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.951417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.952272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.253423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:43.263764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-312054b6-9e5b-4acf-96ae-edf7f2637a49 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.771856 Sep 07 13:33:43.264952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 54/102] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:42 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:43.270501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:43.271481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:43.280081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:43.280864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:43.281469 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.282906 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:43.283819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:43.284445 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.400386 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:43.436077 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0a16a1f9-6e01-49ef-8757-1b49c0131d23 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1515 microversion: 2.1 time: 0.532015 Sep 07 13:33:43.438512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 49/103] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:42 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1515 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:43.450829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-08073229-072d-478d-aa33-e6ec308ac9a9 req-977a5f78-3841-4fb0-8550-9e127005232e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd3d8fa7-7daf-4ceb-9906-985ba2fe332f", "name": "network-vif-plugged", "status": "completed", "tag": "faac008a-f2a5-4e65-bbd0-203541bb181e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:43.493532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-08073229-072d-478d-aa33-e6ec308ac9a9 req-977a5f78-3841-4fb0-8550-9e127005232e service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:43.495424 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-08073229-072d-478d-aa33-e6ec308ac9a9 req-977a5f78-3841-4fb0-8550-9e127005232e service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:43.496220 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-08073229-072d-478d-aa33-e6ec308ac9a9 req-977a5f78-3841-4fb0-8550-9e127005232e service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.533330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-08073229-072d-478d-aa33-e6ec308ac9a9 req-977a5f78-3841-4fb0-8550-9e127005232e service nova] Creating event network-vif-plugged:faac008a-f2a5-4e65-bbd0-203541bb181e for instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f on hv-cinder-85625 Sep 07 13:33:43.557218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-08073229-072d-478d-aa33-e6ec308ac9a9 req-977a5f78-3841-4fb0-8550-9e127005232e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114107 Sep 07 13:33:43.559740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 50/104] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:43.575081 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:43.581090 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:43.587869 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=18 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:43.608283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:43.610224 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:43.611587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.613272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:43.614456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:43.615689 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.791445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'flavor' on Instance uuid 9a2ca409-5b36-4b33-8293-98ab05050fb8 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:33:43.799001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:43.821530 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:43.824420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:43.826945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b3b2212b-4e58-4ade-832c-deb36e2cbf4d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.560235 Sep 07 13:33:43.828984 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 55/105] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:43 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:43.850468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:43.851720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:43.864833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:43.884168 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:43.886151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:43.887339 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.888682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:43.889301 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:43.903121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.130301 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:44.141054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-79ecf085-1d6f-4c9a-9a94-4ac0bcfa6b6f tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1499 microversion: 2.1 time: 0.310152 Sep 07 13:33:44.143332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 56/106] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:43 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1499 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:44.148725 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:44.149760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:44.159327 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.161761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.163069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.164188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.178695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.179994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.457725 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:44.480932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-649ac8e5-26ae-4893-bd64-21ca4e1bf9f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.335829 Sep 07 13:33:44.482700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 57/107] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:44 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:44.505146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:44.506438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:44.507925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9e81798b-4667-400f-ab1e-f9d2e76cd251 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8/action" status: 200 len: 32 microversion: 2.1 time: 0.943996 Sep 07 13:33:44.510381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 51/108] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:33:43 2022] POST /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8/action => generated 32 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:33:44.515491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.516757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.517217 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.518096 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.518473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.518902 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.522560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=100 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:44.523052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:44.523948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:44.568770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.569858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.570685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.578507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.580570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.597442 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.108669 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=18 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:45.155799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:45.182887 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6eb804ee-7559-4bbb-8b5a-b785dd8b0cc7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.696627 Sep 07 13:33:45.192542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 58/109] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:44 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:45.205864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-73dfa7c7-5a03-44e8-b520-8c06ca011417 req-6571b59f-2baa-41d5-b3c4-72ce844b8628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d77c88-2507-41f1-a8bf-604880929568", "tag": "dbb94b1d-c06e-4515-a9ea-b00bd9245f9d"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:45.239353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-73dfa7c7-5a03-44e8-b520-8c06ca011417 req-6571b59f-2baa-41d5-b3c4-72ce844b8628 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:45.240552 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-73dfa7c7-5a03-44e8-b520-8c06ca011417 req-6571b59f-2baa-41d5-b3c4-72ce844b8628 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:45.241559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-73dfa7c7-5a03-44e8-b520-8c06ca011417 req-6571b59f-2baa-41d5-b3c4-72ce844b8628 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.264147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-73dfa7c7-5a03-44e8-b520-8c06ca011417 req-6571b59f-2baa-41d5-b3c4-72ce844b8628 service nova] Creating event network-changed:dbb94b1d-c06e-4515-a9ea-b00bd9245f9d for instance 78d77c88-2507-41f1-a8bf-604880929568 on hv-cinder-85625 Sep 07 13:33:45.273848 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-73dfa7c7-5a03-44e8-b520-8c06ca011417 req-6571b59f-2baa-41d5-b3c4-72ce844b8628 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078769 Sep 07 13:33:45.278697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 59/110] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:45.309376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:45.310760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:45.333694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:45.334582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:45.373094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:45.396794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-59e5f7f9-933b-45f6-a4d4-08e61b1addf8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.869928 Sep 07 13:33:45.397438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.397438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:45.397438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:45.397438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.398068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 52/111] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:44 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:45.516172 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:45.516839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:45.540188 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:45.540685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:45.541184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.542997 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:45.544068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:45.544656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.894927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:45.909058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:45.912030 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:45.913624 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f60df6d4-400b-45d9-88d3-5c14dfe4b413 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.633535 Sep 07 13:33:45.914919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 60/112] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:45 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:46.238274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:46.254015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:46.263918 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.276766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.277883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.279354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.280178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.281154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.390685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:46.403507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-48f1c971-3fb8-4c45-98f1-d8903c8c7f09 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.894116 Sep 07 13:33:46.404720 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 53/113] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:45 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:46.413645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:46.414595 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:46.426296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.427101 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.429312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.430737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.433367 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.434222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.848459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:46.861728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1b1f079b-12e1-4810-872b-6dcbd5223df6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.630424 Sep 07 13:33:46.880041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 61/114] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:46 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:46.962341 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:46.963911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:46.973265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.975001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.976071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.977273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.978045 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.978665 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.989653 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:47.001918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8131c32c-d3f3-4c9e-b4e4-9d4afc163130 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.593087 Sep 07 13:33:47.002897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 54/115] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:46 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:47.301635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:47.320318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:47.324548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:47.326842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6a34131c-f639-4025-92d0-2b02d8fcec7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.370510 Sep 07 13:33:47.328050 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 62/116] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:46 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:33:47.447925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:47.448764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:47.450955 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:47.457229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.457717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.458183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:47.459652 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.459652 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.459984 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:47.719784 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:47.732066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e6c0c7c-e729-4a84-9282-8b02f32b9e51"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:47.741947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:47.764415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b640105d-92e4-4cbe-ba5a-766863ec0800 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1362 microversion: 2.1 time: 0.317992 Sep 07 13:33:47.765843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 55/117] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:47 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:47.769533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.770620 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.771521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:47.773271 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.774744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.776984 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:47.896890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:47.898627 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:47.910297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.911663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.912881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:47.918021 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.919152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.921558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:48.377915 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:48.377915 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-003b39f3-3071-4026-bc5d-b910f08674a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.488238 Sep 07 13:33:48.381539 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 56/118] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:47 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:48.388438 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:48.389473 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:48.400456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:48.402171 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:48.402848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:48.403864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:48.404627 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:48.405304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:48.725849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:48.743359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-517a496e-a827-4da7-8ec2-bf2ad2939537 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.359798 Sep 07 13:33:48.745401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 57/119] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:48 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:48.751021 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:48.752004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:48.760933 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:48.765426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:48.765426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:48.765426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:48.765426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:48.765787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:49.036293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:49.066400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:49.071656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:49.076151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cb51df62-308c-403b-af20-8bf39ccc9a3b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.328990 Sep 07 13:33:49.077657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 58/120] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:48 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:49.107279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:49.108474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:49.122517 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:49.123371 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:49.124875 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:49.126120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:49.126883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:49.127630 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:49.370343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:49.407548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a02b3bea-aa33-4c56-86b7-5ec701edad17 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1548 microversion: 2.1 time: 0.327271 Sep 07 13:33:49.415772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 59/121] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:49 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1548 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:49.433626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:49.434619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:49.473401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:49.478060 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:49.478807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:49.480578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:49.485515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:49.486701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:49.931384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:49.946420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8bd74332-c729-435c-aba4-3cd86eb61d92 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.520345 Sep 07 13:33:49.948087 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 60/122] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:49 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:49.960468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:49.961603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:49.975359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:49.975359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:49.976265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:49.977529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:49.978108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:49.979308 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.066069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9208cd25-bc63-4e4c-af78-1ae9f6b6554e tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "POST /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.343042 Sep 07 13:33:50.078082 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 63/123] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:33:47 2022] POST /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699/os-volume_attachments => generated 194 bytes in 2346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:33:50.078082 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-d4732a35-9d81-4949-a17b-d46e8e10b0ac req-131351ad-4825-48d8-b55e-5a8c36d17a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3f1350-9b24-4671-8770-5bdc7f6921a1", "name": "network-vif-plugged", "status": "completed", "tag": "06a799cf-4ec2-424a-9ae1-0a28f235a093"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:50.093198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-d4732a35-9d81-4949-a17b-d46e8e10b0ac req-131351ad-4825-48d8-b55e-5a8c36d17a57 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:50.093913 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-d4732a35-9d81-4949-a17b-d46e8e10b0ac req-131351ad-4825-48d8-b55e-5a8c36d17a57 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:50.094587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-d4732a35-9d81-4949-a17b-d46e8e10b0ac req-131351ad-4825-48d8-b55e-5a8c36d17a57 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.125793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-d4732a35-9d81-4949-a17b-d46e8e10b0ac req-131351ad-4825-48d8-b55e-5a8c36d17a57 service nova] Creating event network-vif-plugged:06a799cf-4ec2-424a-9ae1-0a28f235a093 for instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 on hv-cinder-85625 Sep 07 13:33:50.137132 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-d4732a35-9d81-4949-a17b-d46e8e10b0ac req-131351ad-4825-48d8-b55e-5a8c36d17a57 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066811 Sep 07 13:33:50.137864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-09fe740a-44f6-4332-9d83-c06e61e92476 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187304 Sep 07 13:33:50.138617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 64/124] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:50.139415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 61/125] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:33:49 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:50.148835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:50.149815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:50.151494 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:50.153635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:50.162887 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:50.163246 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:50.163876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:50.164122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:50.164804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.164995 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.165848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:50.166082 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:50.167148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:50.173337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.182603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:50.188137 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.208907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:50.596560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:50.612471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:50.623807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:50.623807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-642dd8a6-27c8-41be-a527-d4d446e5381f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.476858 Sep 07 13:33:50.623807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 62/126] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:50 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:50.734531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:50.753002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-43c8ef71-4104-4437-8c65-0aea380f404b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.612132 Sep 07 13:33:50.764405 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 65/127] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:50 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:50.993139 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:50.999540 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:51.014099 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.015503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.016913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.019509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.021144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.022333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.328107 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:51.346562 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5b834277-b6f3-401e-b998-87ca8cc71ef0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.362182 Sep 07 13:33:51.347531 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 63/128] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:50 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:51.645891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:51.647571 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:51.657265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.658048 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.659020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.660108 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.660664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.661366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.782762 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:51.784011 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:51.796353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.797181 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.797929 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.799821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.800967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.801967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.893996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:51.909387 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:51.912332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:51.914256 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bab5c346-7c24-48b8-b6f2-38e6ca4604f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.272381 Sep 07 13:33:51.915217 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 66/129] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:51 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:52.013760 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:52.029253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4f87a739-4d2b-478c-8745-20be5cb99e2a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.253302 Sep 07 13:33:52.043413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 64/130] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:51 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:52.395791 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:52.396867 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:52.409682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:52.410267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:52.410852 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:52.411930 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:52.413249 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:52.413853 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:52.931744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:52.947841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-665207b0-f1db-4293-b887-150198580a83 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1366 microversion: 2.1 time: 0.561253 Sep 07 13:33:52.959706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 67/131] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:52 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1366 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:52.963101 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:52.964602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:52.972174 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:52.972817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:52.973263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:52.974264 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:52.974832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:52.975296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:53.075851 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:53.076752 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:53.088778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:53.088778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:53.088778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:53.088778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:53.095150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:53.099756 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:53.230795 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:53.244410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:53.246433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:53.248109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e79c2315-d6db-49fa-8c26-956f3f2900f3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.293384 Sep 07 13:33:53.248938 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 65/132] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:52 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:33:53.254698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-ea8d2721-0b1e-4551-b524-f6588ac9b4ab req-dbdeab51-5ffd-4b24-9fbb-43b35878142b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd3d8fa7-7daf-4ceb-9906-985ba2fe332f", "tag": "faac008a-f2a5-4e65-bbd0-203541bb181e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:53.284215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-ea8d2721-0b1e-4551-b524-f6588ac9b4ab req-dbdeab51-5ffd-4b24-9fbb-43b35878142b service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:53.285492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-ea8d2721-0b1e-4551-b524-f6588ac9b4ab req-dbdeab51-5ffd-4b24-9fbb-43b35878142b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:53.286438 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-ea8d2721-0b1e-4551-b524-f6588ac9b4ab req-dbdeab51-5ffd-4b24-9fbb-43b35878142b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:53.321058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-ea8d2721-0b1e-4551-b524-f6588ac9b4ab req-dbdeab51-5ffd-4b24-9fbb-43b35878142b service nova] Creating event network-changed:faac008a-f2a5-4e65-bbd0-203541bb181e for instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f on hv-cinder-85625 Sep 07 13:33:53.333574 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-ea8d2721-0b1e-4551-b524-f6588ac9b4ab req-dbdeab51-5ffd-4b24-9fbb-43b35878142b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082586 Sep 07 13:33:53.334651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 66/133] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:53.590922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:53.611450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0e292145-f01f-4d43-88f4-c552ed213958 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.541888 Sep 07 13:33:53.613252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 68/134] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:53 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:53.777707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-96fdad42-a12c-4b54-9087-8cedf112f8d3 req-8d237b4e-c628-4c5b-8273-ec5348c35c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d77c88-2507-41f1-a8bf-604880929568", "name": "network-vif-plugged", "status": "completed", "tag": "dbb94b1d-c06e-4515-a9ea-b00bd9245f9d"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:53.810521 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-96fdad42-a12c-4b54-9087-8cedf112f8d3 req-8d237b4e-c628-4c5b-8273-ec5348c35c4f service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:53.811963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-96fdad42-a12c-4b54-9087-8cedf112f8d3 req-8d237b4e-c628-4c5b-8273-ec5348c35c4f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:53.813044 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-96fdad42-a12c-4b54-9087-8cedf112f8d3 req-8d237b4e-c628-4c5b-8273-ec5348c35c4f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:53.838227 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-96fdad42-a12c-4b54-9087-8cedf112f8d3 req-8d237b4e-c628-4c5b-8273-ec5348c35c4f service nova] Creating event network-vif-plugged:dbb94b1d-c06e-4515-a9ea-b00bd9245f9d for instance 78d77c88-2507-41f1-a8bf-604880929568 on hv-cinder-85625 Sep 07 13:33:53.850799 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-96fdad42-a12c-4b54-9087-8cedf112f8d3 req-8d237b4e-c628-4c5b-8273-ec5348c35c4f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083248 Sep 07 13:33:53.859574 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 67/135] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:53.989881 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:53.991268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:54.007904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.008780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.009556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.023210 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.024060 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.026004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.289206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:54.289947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:54.302901 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.303452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.304056 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.305085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.305733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.306380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.630515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:54.662547 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e5477c03-b789-4383-8304-0fc1aad57383 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1556 microversion: 2.1 time: 0.673940 Sep 07 13:33:54.668346 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 69/136] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:53 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1556 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:54.688340 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:54.689732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:54.734019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.739755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.740947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.751638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.753162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.754137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.793447 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:54.824860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:54.827115 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:54.828805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3f358835-f38e-4775-b4f3-3d7842a5dec3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.550159 Sep 07 13:33:54.840765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 68/137] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:54 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:33:54.860562 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:54.865322 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:54.888330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.892465 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.898555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.899660 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:54.900326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:54.901924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:55.128149 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-446b2031-5939-4271-9c2b-c69083959fce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283142 Sep 07 13:33:55.128535 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 69/138] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:33:54 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-interface => generated 284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:55.192448 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:55.221748 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-195a3efb-d59f-45c1-97cc-821ffb40ff02 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.550973 Sep 07 13:33:55.222796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 70/139] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:54 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:55.875318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:55.875318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:55.886471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:55.888548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:55.889131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:55.889853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:55.892567 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:55.893924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:56.278856 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:56.280308 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:56.293600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:56.294952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:56.296056 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:56.297870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:56.299274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:56.300194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:56.459707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:56.497389 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:56.500454 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:56.503336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-59554b08-b15b-4e0b-9011-78e08fdbe485 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1407 microversion: 2.20 time: 0.644516 Sep 07 13:33:56.504476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 70/140] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:55 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1407 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:56.587636 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:56.605005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4c6a5634-ef97-489d-83e4-65b09c5018fb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.333353 Sep 07 13:33:56.606424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 71/141] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:56 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:57.550120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:57.557489 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:57.577245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:57.578467 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:57.581597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:57.583392 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:57.588751 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:57.589488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:57.649329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:57.650495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:57.672554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:57.673430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:57.674387 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:57.686539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:57.688454 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:57.689526 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:57.936322 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:57.959423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:57.970107 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:57.973680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:57.976064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c3ddcbcf-f6e1-432e-8279-36b6d16a57ef tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1600 microversion: 2.20 time: 0.434727 Sep 07 13:33:57.977306 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 71/142] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:33:57 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1600 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:33:58.018057 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4749bb00-0c26-4cc5-9f0f-be8fbaeca265 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.376174 Sep 07 13:33:58.018812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 72/143] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:57 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:58.067236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:58.068266 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:58.087470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:58.090111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:58.092486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:58.094391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:58.096134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:58.098438 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:58.354529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4e9b658d-ba45-4c12-8d27-82510e60a670 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.317179 Sep 07 13:33:58.356097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 72/144] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Sep 7 13:33:58 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-interface => generated 285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:33:58.412666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-a63e910a-8594-46ff-b929-62345bd63e1c req-ba2f885f-322e-4dbc-be4c-6e31822105bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3f1350-9b24-4671-8770-5bdc7f6921a1", "tag": "06a799cf-4ec2-424a-9ae1-0a28f235a093"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:58.430798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a63e910a-8594-46ff-b929-62345bd63e1c req-ba2f885f-322e-4dbc-be4c-6e31822105bb service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:58.432982 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a63e910a-8594-46ff-b929-62345bd63e1c req-ba2f885f-322e-4dbc-be4c-6e31822105bb service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:58.434166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a63e910a-8594-46ff-b929-62345bd63e1c req-ba2f885f-322e-4dbc-be4c-6e31822105bb service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:58.455994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-a63e910a-8594-46ff-b929-62345bd63e1c req-ba2f885f-322e-4dbc-be4c-6e31822105bb service nova] Creating event network-changed:06a799cf-4ec2-424a-9ae1-0a28f235a093 for instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 on hv-cinder-85625 Sep 07 13:33:58.469609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-a63e910a-8594-46ff-b929-62345bd63e1c req-ba2f885f-322e-4dbc-be4c-6e31822105bb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073617 Sep 07 13:33:58.471664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 73/145] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:59.065754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:59.069516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:59.084621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:59.086092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:59.087600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:59.091179 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:59.092517 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:59.093639 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:59.460217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:59.487977 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b5d7fbf7-fcdd-4a58-bd0d-27014605b846 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.420364 Sep 07 13:33:59.487977 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 73/146] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:59 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:00.539442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:00.546349 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:00.571580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:00.575632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:00.595956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:00.597334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:00.597663 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:00.598004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:01.377508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:01.390196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c68c52b8-6413-44e7-a9dc-100152e62887 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.865008 Sep 07 13:34:01.399174 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 74/147] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:00 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:02.046173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-efb77c29-e7f1-4284-9c73-f3589d871bc2 req-8b365873-4abd-4a76-b6ac-5d30461ce5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d77c88-2507-41f1-a8bf-604880929568", "tag": "dbb94b1d-c06e-4515-a9ea-b00bd9245f9d"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:02.076559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-efb77c29-e7f1-4284-9c73-f3589d871bc2 req-8b365873-4abd-4a76-b6ac-5d30461ce5a6 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.077059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-efb77c29-e7f1-4284-9c73-f3589d871bc2 req-8b365873-4abd-4a76-b6ac-5d30461ce5a6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.077509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-efb77c29-e7f1-4284-9c73-f3589d871bc2 req-8b365873-4abd-4a76-b6ac-5d30461ce5a6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.120441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-efb77c29-e7f1-4284-9c73-f3589d871bc2 req-8b365873-4abd-4a76-b6ac-5d30461ce5a6 service nova] Creating event network-changed:dbb94b1d-c06e-4515-a9ea-b00bd9245f9d for instance 78d77c88-2507-41f1-a8bf-604880929568 on hv-cinder-85625 Sep 07 13:34:02.147937 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-efb77c29-e7f1-4284-9c73-f3589d871bc2 req-8b365873-4abd-4a76-b6ac-5d30461ce5a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105096 Sep 07 13:34:02.158838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 74/148] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:02.265073 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:02.266955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:02.276267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.277189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.278007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.279146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.279796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.280450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.313977 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:02.333582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:34:02.416862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:02.417827 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:02.435217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.435827 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.438167 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.439088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.440605 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.443776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.835654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:02.864934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9a4ca0e5-ab77-48ec-ad61-36e682b8e2ab tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.453075 Sep 07 13:34:02.869903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 75/149] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:02 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:02.891479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-58699212-0c28-47b7-a1f0-834a4c38e7a2 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 204 len: 0 microversion: 2.1 time: 0.626083 Sep 07 13:34:02.892198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 75/150] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:34:02 2022] DELETE /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:34:02.910964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:02.910964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:02.933056 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.941559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.941559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.941559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.941559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.942110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:03.246216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:03.259153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-73b0c1b0-02f3-48dc-9724-ea59d4c26870 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1551 microversion: 2.1 time: 0.360596 Sep 07 13:34:03.261781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 76/151] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:02 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1551 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:03.924239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:03.924239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:03.939125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:03.940015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:03.941238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:03.943010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:03.944316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:03.947187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:04.203019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:04.225593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-418b8229-191f-4dd8-92df-62fa9b102a1d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.316525 Sep 07 13:34:04.234964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 76/152] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:03 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:04.287778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:04.289070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:04.299488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:04.300305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:04.301079 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:04.312585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:04.313892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:04.314657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:04.578954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:04.599848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4bc35c33-9822-47d7-9e53-3f9e239f8fd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1551 microversion: 2.1 time: 0.316864 Sep 07 13:34:04.603033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 77/153] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:04 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1551 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:05.277281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:05.277984 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:05.285929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:05.286957 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:05.287560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:05.288594 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:05.289331 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:05.290102 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:05.531380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:05.552604 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-74ea6b12-8888-4cb5-999a-4f21ffd16f4f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.282683 Sep 07 13:34:05.554120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 77/154] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:05 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:05.633603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:05.643289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:05.651283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:05.653202 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:05.653202 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:05.654421 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:05.655212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:05.655975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:06.410289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:06.428842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0c7b5121-ba4b-4cd3-a4e8-f3b26e544d5c tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1551 microversion: 2.1 time: 0.804352 Sep 07 13:34:06.430270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 78/155] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:05 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1551 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:06.603284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:06.604649 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:06.616174 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:06.617578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:06.617578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:06.621462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:06.621462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:06.621883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:06.947238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:06.971332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b8be8112-9d02-459a-9290-46e1a94acdf4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.367111 Sep 07 13:34:06.971332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 78/156] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:06 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:07.268304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-e7dff80c-98b7-4d11-bb78-0de850e36598 req-db266b19-4ac1-48e4-a30b-85eee204d701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3139a784-1167-480e-88d9-659183c28699", "name": "network-vif-deleted", "tag": "15ad3583-f182-4a2a-987d-d62ee7ad2e34"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:07.295162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e7dff80c-98b7-4d11-bb78-0de850e36598 req-db266b19-4ac1-48e4-a30b-85eee204d701 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:07.295864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e7dff80c-98b7-4d11-bb78-0de850e36598 req-db266b19-4ac1-48e4-a30b-85eee204d701 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:07.296468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e7dff80c-98b7-4d11-bb78-0de850e36598 req-db266b19-4ac1-48e4-a30b-85eee204d701 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:07.316610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-e7dff80c-98b7-4d11-bb78-0de850e36598 req-db266b19-4ac1-48e4-a30b-85eee204d701 service nova] Creating event network-vif-deleted:15ad3583-f182-4a2a-987d-d62ee7ad2e34 for instance 3139a784-1167-480e-88d9-659183c28699 on hv-cinder-85625 Sep 07 13:34:07.323683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-e7dff80c-98b7-4d11-bb78-0de850e36598 req-db266b19-4ac1-48e4-a30b-85eee204d701 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069972 Sep 07 13:34:07.324296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 79/157] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:07.461680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:07.463418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:07.474668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:07.475662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:07.476384 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:07.477584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:07.479032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:07.480138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:07.567633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:07.587054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-31790565-fca9-420b-a60b-eb7c2d8b8663 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1344 microversion: 2.1 time: 0.131340 Sep 07 13:34:07.588686 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 79/158] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:07 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:08.023229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:08.024065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:08.032039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:08.036432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:08.036432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:08.036432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:08.036432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:08.037284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:08.255065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:08.268448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b554001a-a422-42e0-b424-ed8faa8a390b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.251450 Sep 07 13:34:08.269360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 80/159] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:08 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:08.626545 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:08.627241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:08.635551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:08.636107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:08.636519 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:08.637243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:08.637700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:08.638238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:08.764441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:08.783218 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-29d92f41-af1d-49b9-b272-ba29bd3ec195 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1344 microversion: 2.1 time: 0.161611 Sep 07 13:34:08.783823 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 80/160] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:08 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1344 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:09.300071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:09.308811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:09.317644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:09.318793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:09.319516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:09.320578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:09.321470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:09.323898 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:09.606921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:09.615380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-20d0b8f2-131e-4b93-9162-93cfd939bc40 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.323744 Sep 07 13:34:09.615979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 81/161] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:09 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:09.818751 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:09.820120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:09.828126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:09.828610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:09.829041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:09.829874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:09.830421 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:09.830912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:09.913285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:09.928425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-57f7de34-3f5a-4024-b6f6-e018245e386d tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1344 microversion: 2.1 time: 0.116241 Sep 07 13:34:09.929379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 81/162] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:09 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:10.643790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:10.644769 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:10.653636 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:10.654362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:10.654822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:10.655642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:10.656286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:10.656764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:10.662037 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:10.878707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:10.889419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9046db81-7c87-45fa-84f6-bc76813ae0ec tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.250639 Sep 07 13:34:10.890147 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 82/163] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:10 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:10.960564 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:10.961875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:10.972963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:10.973835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:10.974666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:10.976347 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:10.977227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:10.978016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:11.129600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:11.154703 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-76b1db3f-a438-4ca4-a306-713ad36b5025 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1344 microversion: 2.1 time: 0.202539 Sep 07 13:34:11.157656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 82/164] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:10 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1344 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:11.932095 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:11.939157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:11.951691 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:11.952604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:11.953132 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:11.954089 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:11.954876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:11.955654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:12.202286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:12.202909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:12.206456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:12.213194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:12.213194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:12.213194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:12.213194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:12.213554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:12.213947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:12.222773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7faeef0a-28e3-4baa-8544-69399469a0d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.297992 Sep 07 13:34:12.235382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 83/165] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:11 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:12.258207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:12.260010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:12.260698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:12.261934 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lazy-loading 'fault' on Instance uuid 3139a784-1167-480e-88d9-659183c28699 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:34:12.352906 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80341b19855e496b96b2948b916db613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db02cd9acdc4dc9b42a6b1ee5cc2f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:12.362443 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3feec58e-7c19-4417-9c4c-3409589fb2ad tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 200 len: 1349 microversion: 2.1 time: 0.170925 Sep 07 13:34:12.384114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 83/166] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:12 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 1349 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:13.281746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:13.282415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:13.290443 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.291892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.292778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.293825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.294788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.295417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.396929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:13.396929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:13.407466 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.407775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.408466 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.410367 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.412629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.414427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.441665 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] HTTP exception thrown: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Request method failure captured: Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 HTTP/1.1 Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2G7EPY0mprmoNgMmvsgD75bvPTB2D64PqAOY7jDhxtmrIuLeOI6f_yRo9o8yzgntvhv7Uc8sofctDoijzOH3bBFs2swzCNO3d-lJl2b2u8jgUaCpq3Ybwfq6Pl2OWSFYLsuWgAJBTlxHghdDysgvdSNv89PBC-3AhUHPowPU3UMx0 Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:34:13.461816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5db02cd9acdc4dc9b42a6b1ee5cc2f23", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 80341b19855e496b96b2948b916db613 Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.465106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '3139a784-1167-480e-88d9-659183c28699'} Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:13.466068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.468515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.472080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Returning 404 to user: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:13.472080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4e88ca17-1dfc-4ce5-a364-35679c07ddd8 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 404 len: 111 microversion: 2.1 time: 0.079209 Sep 07 13:34:13.472080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 84/167] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:13 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:13.489805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:13.500457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6ef2ceef-1aaf-48a0-98f2-be057c343386 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.224125 Sep 07 13:34:13.501097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 84/168] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:13 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:13.825980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:13.828650 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:13.844863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.844863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.844863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.844863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.845330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.845330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.869289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] HTTP exception thrown: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Request method failure captured: Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699/os-volume_attachments HTTP/1.1 Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2G7EPY0mprmoNgMmvsgD75bvPTB2D64PqAOY7jDhxtmrIuLeOI6f_yRo9o8yzgntvhv7Uc8sofctDoijzOH3bBFs2swzCNO3d-lJl2b2u8jgUaCpq3Ybwfq6Pl2OWSFYLsuWgAJBTlxHghdDysgvdSNv89PBC-3AhUHPowPU3UMx0 Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:34:13.872777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5db02cd9acdc4dc9b42a6b1ee5cc2f23", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 80341b19855e496b96b2948b916db613 Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.879672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'server_id': '3139a784-1167-480e-88d9-659183c28699'} Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:13.881092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:13.883250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:13.886554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Returning 404 to user: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:13.886554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5c00d512-612b-4cbb-aaf1-7c16c1640bd5 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058126 Sep 07 13:34:13.888658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 85/169] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:34:13 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:14.550118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:14.551209 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:14.561186 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.561971 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.562679 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:14.563891 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.564939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.565746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:14.788299 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:14.802453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7d865bed-1d62-4de2-b269-c1698d5164de tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.267149 Sep 07 13:34:14.804491 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 85/170] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:14 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:15.504301 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.505154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:15.513707 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.514297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.514800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.515662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.516165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.516680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.534089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] HTTP exception thrown: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Request method failure captured: Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 HTTP/1.1 Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2G7EPY0mprmoNgMmvsgD75bvPTB2D64PqAOY7jDhxtmrIuLeOI6f_yRo9o8yzgntvhv7Uc8sofctDoijzOH3bBFs2swzCNO3d-lJl2b2u8jgUaCpq3Ybwfq6Pl2OWSFYLsuWgAJBTlxHghdDysgvdSNv89PBC-3AhUHPowPU3UMx0 Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:34:15.535737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5db02cd9acdc4dc9b42a6b1ee5cc2f23", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 80341b19855e496b96b2948b916db613 Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.537160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '3139a784-1167-480e-88d9-659183c28699'} Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:15.537805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.539089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.547089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Returning 404 to user: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:15.547089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a0d976c9-53a6-4a8e-9525-b06ed97944a4 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 404 len: 111 microversion: 2.1 time: 0.041736 Sep 07 13:34:15.547089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 86/171] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:34:15 2022] DELETE /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:34:15.552017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.552745 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] [instance: 3139a784-1167-480e-88d9-659183c28699] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:15.559915 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.560471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.560910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.561620 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.562074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.562496 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.580339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] HTTP exception thrown: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Request method failure captured: Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 HTTP/1.1 Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2G7EPY0mprmoNgMmvsgD75bvPTB2D64PqAOY7jDhxtmrIuLeOI6f_yRo9o8yzgntvhv7Uc8sofctDoijzOH3bBFs2swzCNO3d-lJl2b2u8jgUaCpq3Ybwfq6Pl2OWSFYLsuWgAJBTlxHghdDysgvdSNv89PBC-3AhUHPowPU3UMx0 Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:34:15.585612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5db02cd9acdc4dc9b42a6b1ee5cc2f23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5db02cd9acdc4dc9b42a6b1ee5cc2f23", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 5db02cd9acdc4dc9b42a6b1ee5cc2f23 Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-DeleteServersTestJSON-4555736 Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 80341b19855e496b96b2948b916db613 Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-DeleteServersTestJSON-4555736-project Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.588502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '3139a784-1167-480e-88d9-659183c28699'} Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:15.590182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. Sep 07 13:34:15.592776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.595515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] Returning 404 to user: Instance 3139a784-1167-480e-88d9-659183c28699 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:15.595515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-26c2353b-aadf-45ac-8904-6bfcdc2c7233 tempest-DeleteServersTestJSON-4555736 tempest-DeleteServersTestJSON-4555736-project] 10.222.0.62 "GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699" status: 404 len: 111 microversion: 2.1 time: 0.039524 Sep 07 13:34:15.595515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 86/172] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:15 2022] GET /compute/v2.1/servers/3139a784-1167-480e-88d9-659183c28699 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:15.842253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.842882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:15.850178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.851124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.851900 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.853821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.854956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.856028 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:16.203518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:16.214141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c627af14-e7de-4b10-ab79-e40da36939d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.376378 Sep 07 13:34:16.214725 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 87/173] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:15 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:17.261564 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:17.264528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:17.288473 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:17.291598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:17.296198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:17.297639 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:17.299341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:17.301253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:17.702936 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:17.723277 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0e2d030c-841e-4ea2-b7f5-c73273839cc2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.470731 Sep 07 13:34:17.724511 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 87/174] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:17 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:18.769822 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:18.771052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:18.776656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:18.792144 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:18.792320 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:18.793595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:18.795302 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:18.796639 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:18.797905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:19.151237 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:19.183227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1b28d686-8287-4edb-a1a3-87cf1aa3814e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.419663 Sep 07 13:34:19.184014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 88/175] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:18 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:20.227228 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:20.229043 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:20.237592 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:20.239832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:20.240852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:20.241945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:20.242660 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:20.244338 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:20.822681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:20.851787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-15ead131-a37c-4022-b6a9-e46bc6a43653 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.633780 Sep 07 13:34:20.854013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 88/176] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:20 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:21.887353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:21.888063 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:21.908100 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:21.908803 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:21.909482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:21.910656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:21.911727 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:21.912318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:22.191099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:22.201199 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0675ec0e-0a13-484d-963a-52cb63235269 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.318889 Sep 07 13:34:22.215737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 89/177] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:21 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:23.233300 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:23.235466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:23.239336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=68 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:23.248615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:23.249384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:23.250154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:23.251422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:23.252254 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:23.253033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:23.482598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:23.518261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9872893f-4762-4c0f-8847-33ecdb3b39b5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.288445 Sep 07 13:34:23.518261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 89/178] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:23 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:24.545630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:24.546546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:24.554028 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:24.554606 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:24.555090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:24.556405 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:24.557431 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:24.558117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:24.764356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:24.779174 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-016341f1-1a18-4fda-b7da-61b0a3e23a5d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1521 microversion: 2.1 time: 0.238668 Sep 07 13:34:24.780202 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 90/179] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:24 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:25.810947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:25.811721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:25.824907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:25.826143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:25.827144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:25.828698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:25.829415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:25.830132 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:26.044151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:26.062765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-810598f0-1059-4665-8f99-b2403c46cab5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1501 microversion: 2.1 time: 0.259749 Sep 07 13:34:26.068027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 90/180] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:25 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1501 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:26.108784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:26.109915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:26.123267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:26.124229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:26.125165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:26.126430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:26.127191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:26.127939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:26.352305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:26.352305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a71e13b0-1e0e-4ab1-b80d-e1f6cf8e4ba0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1516 microversion: 2.1 time: 0.249631 Sep 07 13:34:26.352305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 91/181] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:26 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:28.933786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:28.938910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:28.951148 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:28.952039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:28.952895 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:28.954120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:28.954984 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:28.955801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:29.002756 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'flavor' on Instance uuid 72f676c6-6bfd-4c01-b135-da2507403d9d {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:34:29.184346 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-751aa055-4260-4105-ad22-2cb763438ac5 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f174c165a60>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:29.248198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-751aa055-4260-4105-ad22-2cb763438ac5 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/27b978bf-5e97-4264-ad4e-9f18da5d0acf" status: 200 len: 350 microversion: 2.1 time: 0.069231 Sep 07 13:34:29.248797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 92/182] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:34:29 2022] GET /compute/v2.1/os-volumes/27b978bf-5e97-4264-ad4e-9f18da5d0acf => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:34:29.436403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0f928156-07cf-4660-9eea-adff51971d21 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d/action" status: 200 len: 32 microversion: 2.1 time: 0.507324 Sep 07 13:34:29.437523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 91/183] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:34:28 2022] POST /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:34:29.455479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:29.457023 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:29.469113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:29.469999 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:29.470793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:29.472172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:29.474522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:29.475148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:29.484796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:29.737548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:29.756642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-581cf7f5-f3eb-4c05-926f-cf4c89938ec5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.311411 Sep 07 13:34:29.758046 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 93/184] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:29 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:30.810221 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:30.810221 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:30.820169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:30.820936 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:30.822178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:30.823412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:30.823947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:30.824840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:31.037907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:31.052006 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2d3e5c79-2ee7-4bd7-983b-05425b108417 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.254353 Sep 07 13:34:31.053354 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 92/185] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:30 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:32.096252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:32.099270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:32.112006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:32.112756 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:32.113645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:32.116785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:32.117379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:32.119830 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:32.375408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:32.390558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6e9ad28c-efd4-4594-966d-cc194a226a71 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.302109 Sep 07 13:34:32.392073 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 94/186] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:32 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:32.712180 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-80dd4ee5-fb5b-4def-9af3-980aa81a7061 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747ef2d30>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:32.807217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-80dd4ee5-fb5b-4def-9af3-980aa81a7061 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/337d30c1-8350-4927-9eaa-c400045dfdf9" status: 200 len: 351 microversion: 2.1 time: 0.103047 Sep 07 13:34:32.807921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 93/187] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:34:32 2022] GET /compute/v2.1/os-volumes/337d30c1-8350-4927-9eaa-c400045dfdf9 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:33.422187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:33.423188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:33.436515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:33.437330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:33.438880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:33.441061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:33.441953 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:33.442719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:33.707378 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:33.707378 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-07357b2d-7470-4a0e-a8fc-086647ab2500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.291516 Sep 07 13:34:33.715719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 95/188] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:33 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:34.739858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:34.741268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:34.753445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:34.754318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:34.755186 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:34.756471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:34.757331 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:34.758118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:35.056495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:35.070474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-00f7c3bb-7e0a-4c5a-a3c3-e90c9f8d41b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.340611 Sep 07 13:34:35.072333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 94/189] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:34 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:35.956046 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-570e027b-f8c8-4c2a-9679-82fd460699b2 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747edd1f0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.019363 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-570e027b-f8c8-4c2a-9679-82fd460699b2 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/83a98a86-c82c-40d2-a656-27d6c59b01ec" status: 200 len: 351 microversion: 2.1 time: 0.068360 Sep 07 13:34:36.019968 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 96/190] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:34:35 2022] GET /compute/v2.1/os-volumes/83a98a86-c82c-40d2-a656-27d6c59b01ec => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:36.037861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f0594d47-4e9b-42d3-8e56-ef2427b3a39b tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747efb0d0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.112812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.113769 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:36.127935 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:36.129214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:36.130645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:36.132474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:36.134308 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:36.135555 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:36.147238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f0594d47-4e9b-42d3-8e56-ef2427b3a39b tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.114400 Sep 07 13:34:36.148219 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 95/191] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:36.189501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-872f453c-d53e-4af7-b43e-10b85cf7ecf7 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747ef0f70>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.350332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-872f453c-d53e-4af7-b43e-10b85cf7ecf7 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.164801 Sep 07 13:34:36.351612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 96/192] 10.222.0.62 () {58 vars in 1149 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:34:36.381697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9fc66ee1-52d5-4444-a57b-ceeacfde4f68 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747efb430>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.386463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:36.399778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3aaed067-77b6-485d-8284-99b7b20307fc tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.291303 Sep 07 13:34:36.401709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 97/193] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:36.513682 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9fc66ee1-52d5-4444-a57b-ceeacfde4f68 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.140215 Sep 07 13:34:36.514484 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 97/194] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:36.534514 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5e538125-ac53-4b32-a568-928f66955f41 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f174c1cad30>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.674882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5e538125-ac53-4b32-a568-928f66955f41 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.146853 Sep 07 13:34:36.677555 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 98/195] 10.222.0.62 () {58 vars in 1167 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:36.699216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-660ea7ae-e89d-4477-be03-1846351f9334 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747ef0310>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.909161 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-660ea7ae-e89d-4477-be03-1846351f9334 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.217714 Sep 07 13:34:36.910207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 98/196] 10.222.0.62 () {58 vars in 1170 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:34:36.943425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ad02668b-b98d-4552-ad05-1680be48f4c7 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f174c194550>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:37.113562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ad02668b-b98d-4552-ad05-1680be48f4c7 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.180769 Sep 07 13:34:37.114753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 99/197] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:37.131524 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-35a5ed3f-5b8b-470c-b9a1-c3e7eef9952a tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747e9e1f0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:37.286663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-35a5ed3f-5b8b-470c-b9a1-c3e7eef9952a tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.159830 Sep 07 13:34:37.288405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 99/198] 10.222.0.62 () {58 vars in 1188 bytes} [Wed Sep 7 13:34:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:37.310522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2d119570-fa82-4bc0-89a3-7ae6fbb38559 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] Calling method '.version_select at 0x7f1747ecdee0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:37.432443 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2d119570-fa82-4bc0-89a3-7ae6fbb38559 tempest-VolumesTestJSON-1311833408 tempest-VolumesTestJSON-1311833408-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.130557 Sep 07 13:34:37.433352 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 100/199] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Sep 7 13:34:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:37.455573 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:37.456646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:37.467006 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:37.467767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:37.468818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:37.470617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:37.471629 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:37.472324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:37.744364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:37.754829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8be6904e-2e29-48ed-8011-f280a022051f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.308174 Sep 07 13:34:37.755570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 100/200] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:37 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:38.606306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:38.607207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:38.617404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.618458 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.619078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.620072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.620556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.621029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.655226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-85820f2e-446c-4fa2-ab00-17c7caa9d748 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/ips" status: 200 len: 144 microversion: 2.1 time: 0.054420 Sep 07 13:34:38.655964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 101/201] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:34:38 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/ips => generated 144 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:38.786941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:38.787693 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:38.797433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.800756 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.801386 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.802212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.802752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.803413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:39.092626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:39.106439 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4587b852-3262-495d-817e-dd5f6a9b1b8c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.323555 Sep 07 13:34:39.111367 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 101/202] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:38 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:40.156261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:40.156942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:40.165976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:40.167072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:40.167692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:40.168864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:40.169643 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:40.170338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:40.472443 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:40.491680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a9145cad-c83f-400e-9063-4976a5d17a26 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.339712 Sep 07 13:34:40.492727 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 102/203] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:40 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:41.538159 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:41.539261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:41.547552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:41.548545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:41.549439 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:41.552927 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:41.553631 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:41.554208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:41.870211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:41.888699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cba3cd6d-9730-4df9-91d4-c3728eb419a8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.358901 Sep 07 13:34:41.904666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 102/204] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:41 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:42.929049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:42.930011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:42.945065 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:42.947227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:42.948094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:42.949408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:42.950472 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:42.951602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:43.243916 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:43.259436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ed8990d3-6b49-480b-9c1e-eba2ef679c39 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.337599 Sep 07 13:34:43.260882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 103/205] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:42 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:44.297624 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:44.298223 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:44.305009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.305856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.306070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:44.306808 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.307453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.317754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:44.317754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:44.537259 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:44.549886 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e916a807-939d-4dea-8de3-27b54984015c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.256661 Sep 07 13:34:44.551155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 103/206] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:44 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:44.801813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07c07715-1fdc-4aec-8f7e-e56d838a6719"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:44.806640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:44.825586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.826495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.828072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:44.829819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.831033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.831807 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:45.240495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-749672685", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "networks": [{"uuid": "1e1ead8d-5077-46db-809a-4b11b304ff3e"}]}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:45.307616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] validate_networks() for [('1e1ead8d-5077-46db-809a-4b11b304ff3e', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:34:46.048919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:34:46.051268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:34:46.052683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:34:46.053895 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:34:46.054899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:34:46.091729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.092808 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.094145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.096507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.103648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.103648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.143648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Getting quotas for project da30824feca04ce79489eaccbb6a7001. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:34:46.152494 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Getting quotas for user 426ecc795ae243ffa7c7e1746e8fc4aa and project da30824feca04ce79489eaccbb6a7001. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:34:46.176532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:34:46.181020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c37f70dc-69f9-4d8c-9a5e-bd78ecc999bf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.388024 Sep 07 13:34:46.182612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 104/207] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:34:44 2022] POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-volume_attachments => generated 194 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:46.182729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:34:46.188872 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:46.189941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:46.198228 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.198931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.199695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.200702 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.201189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.202578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.400799 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2ed42f24-7615-4964-8da0-c836e5e687d3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164405 Sep 07 13:34:46.402560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 104/208] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:34:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:34:46.424992 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-800c0736-7408-41d6-9f54-c1d6094e7195 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:46.428357 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-800c0736-7408-41d6-9f54-c1d6094e7195 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:46.573999 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-800c0736-7408-41d6-9f54-c1d6094e7195 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:46.612361 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-800c0736-7408-41d6-9f54-c1d6094e7195 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1213 microversion: 2.1 time: 0.194499 Sep 07 13:34:46.613147 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 105/209] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:46 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:46.698347 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:46.722840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7769aff9-21a6-44f6-b6bd-513138cb6e5b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.538332 Sep 07 13:34:46.739729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 105/210] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:46 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:47.657260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-31de29ca-5ba7-4b3f-8d26-1920afabde45 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:47.658018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-31de29ca-5ba7-4b3f-8d26-1920afabde45 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:47.738445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-31de29ca-5ba7-4b3f-8d26-1920afabde45 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:47.747205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-31de29ca-5ba7-4b3f-8d26-1920afabde45 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1213 microversion: 2.1 time: 0.095686 Sep 07 13:34:47.747873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 106/211] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:47 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:47.768058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:47.769232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:47.783586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.784901 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.785974 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:47.786871 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.787681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.788190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.007229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:48.027765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-017f85b9-4131-4d73-ba76-922862038232 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.270802 Sep 07 13:34:48.029868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 106/212] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:47 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:48.788771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:48.789878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:48.799408 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.800738 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.801527 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.802966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.803838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.804601 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.910409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:48.925457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-06885ec3-6fcc-4cba-b79a-748d8c1009a2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1217 microversion: 2.1 time: 0.143023 Sep 07 13:34:48.926616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 107/213] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:48 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:49.065866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:49.067126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:49.078866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.083611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.083611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.083611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.083611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.084266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.304475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:49.314414 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cdd70bc2-22cb-4d7a-95f1-1d8a8d78a575 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.253618 Sep 07 13:34:49.315159 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 107/214] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:49 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:49.636729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:49.637242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:49.646278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.646995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.647609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.648368 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.649493 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.650113 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.686529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3c8a06ad-5de2-4414-b818-813e7849393a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/ips" status: 200 len: 153 microversion: 2.20 time: 0.055194 Sep 07 13:34:49.686529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 108/215] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Sep 7 13:34:49 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/ips => generated 153 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:34:49.967788 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:49.968380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:49.976458 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.977141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.977882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.978932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.979490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.980014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:50.070342 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:50.073685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:50.081119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:50.082394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:50.083111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:50.083724 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:50.084681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:50.085378 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:50.086151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:50.096176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-07ae778d-1dc3-4ba6-b487-b82f79f9fa72 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1217 microversion: 2.1 time: 0.132553 Sep 07 13:34:50.107094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 108/216] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:49 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:50.130829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6c30ea12-ddb4-4516-9d7b-d975a587f067 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/ips" status: 200 len: 150 microversion: 2.1 time: 0.065909 Sep 07 13:34:50.131620 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 109/217] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:34:50 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/ips => generated 150 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:50.341835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:50.342455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:50.350025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:50.350569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:50.351359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:50.352260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:50.353924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:50.353924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:50.559490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:50.573886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9e03ac7b-abec-41e3-b4a6-32e596676964 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.237002 Sep 07 13:34:50.575261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 109/218] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:50 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:51.138659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:51.143085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:51.153954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:51.155330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:51.156410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.158193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:51.159218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:51.160001 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.256811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:51.265924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0bf14bfb-42ae-4846-bd3d-dc751c14c13c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1217 microversion: 2.1 time: 0.134942 Sep 07 13:34:51.266467 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 110/219] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:51 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:51.607165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:51.608016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:51.614935 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:51.615465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:51.615909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.616819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:51.617329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:51.618283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.804542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:51.815607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a2a9e50e-0ff4-4bc3-ba12-7e808337e0a0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.212565 Sep 07 13:34:51.816293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 110/220] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:51 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:52.246719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-8799855", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "networks": [{"uuid": "f21941dd-5dfd-4258-80fa-2a9f8f6ea3df"}]}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:52.291704 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:52.292635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:52.299519 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=36 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:52.301574 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.302452 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.302728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.303830 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.304452 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.305417 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.358321 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] validate_networks() for [('f21941dd-5dfd-4258-80fa-2a9f8f6ea3df', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:34:52.388684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:52.404039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a11931af-f810-4a85-bbd2-5528b866b5c5 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1209 microversion: 2.1 time: 0.116937 Sep 07 13:34:52.404899 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 111/221] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:52 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:52.852802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:52.853532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:52.861459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.862147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.863014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.864159 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.864716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.865236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.946263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:34:52.947665 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:34:52.948953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:34:52.949783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:34:52.950591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:34:52.968626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.969523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.970408 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.971848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.972969 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.973696 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.017184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Getting quotas for project e0b6de13e7c64cbdb0f43bddfaebc4ba. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:34:53.032422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Getting quotas for user 6dcde357754a4f668c30c40dc838d09f and project e0b6de13e7c64cbdb0f43bddfaebc4ba. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:34:53.057597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:34:53.060855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:34:53.103806 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:53.111079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:53.127181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-114c69d2-20e2-4081-af79-6ea1fc78e4ed tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1502 microversion: 2.1 time: 0.278359 Sep 07 13:34:53.128091 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 112/222] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:52 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:53.175125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91de6726-37a0-4654-b3fe-9938e4865700"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:53.179127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:53.190043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.190856 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.191794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.192945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.193691 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.194279 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.238626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] HTTP exception thrown: Cannot 'attach_volume' instance 72f676c6-6bfd-4c01-b135-da2507403d9d while it is in vm_state rescued Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Request method failure captured: Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: POST /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d/os-volume_attachments HTTP/1.1 Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 74 Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ17TUxo6EfuBC0CdjNCEeEs91aGmysfruTnTQ9124bG-xdwpvpqCxrTPdNUpOLvDDax6OVm9GYvGDzJM5KNyyPoBv1JyDPCdwoa_eZjHVQmYMFZT8CedEiTEuXxeJvwaaOa-o0Gco-PYuO6-Gx86B8J-sf6yrpuZ9Zp3IrtUK8JwVY Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:34:53.241189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1070aeddb0d544f4b3b4c1e41979944d", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: a145e63a44db43acafc92bb2a238f463 Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {"volumeAttachment": {"volumeId": "91de6726-37a0-4654-b3fe-9938e4865700"}} Sep 07 13:34:53.243460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Cannot 'attach_volume' instance 72f676c6-6bfd-4c01-b135-da2507403d9d while it is in vm_state rescued Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'server_id': '72f676c6-6bfd-4c01-b135-da2507403d9d', 'body': {'volumeAttachment': {'volumeId': '91de6726-37a0-4654-b3fe-9938e4865700'}}} Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f676c6-6bfd-4c01-b135-da2507403d9d in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:53.244712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 72f676c6-6bfd-4c01-b135-da2507403d9d while it is in vm_state rescued Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:53.246780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:53.248891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:53.248891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:53.248891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 72f676c6-6bfd-4c01-b135-da2507403d9d while it is in vm_state rescued Sep 07 13:34:53.248891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:34:53.248891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Returning 409 to user: Cannot 'attach_volume' instance 72f676c6-6bfd-4c01-b135-da2507403d9d while it is in vm_state rescued {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:53.248891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-30734d84-8fc3-4124-927c-84aef466d51b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.082582 Sep 07 13:34:53.248891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 113/223] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:34:53 2022] POST /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d/os-volume_attachments => generated 152 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 13:34:53.256393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:53.257084 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:53.265857 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.266463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.266908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.267726 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.268274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.268707 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.271472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a4fa3b3b-b359-4238-a79e-efad51cc047f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030324 Sep 07 13:34:53.272926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 111/224] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:34:53.285926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-280e9857-703d-43e5-83b7-a596513e0788 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:53.286690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-280e9857-703d-43e5-83b7-a596513e0788 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:53.401004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-280e9857-703d-43e5-83b7-a596513e0788 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:53.413337 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-280e9857-703d-43e5-83b7-a596513e0788 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1216 microversion: 2.1 time: 0.131057 Sep 07 13:34:53.413683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 112/225] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:53 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1216 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:53.436534 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:53.437028 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:53.444245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.444740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.445172 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.445907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.446794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.447445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.527485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:53.534911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-40fcf3c0-f824-407e-bba1-5872655c4208 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1265 microversion: 2.1 time: 0.106261 Sep 07 13:34:53.535684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 113/226] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:53 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:53.541423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e201ba2f-d483-40ca-bbc8-98046971bbda"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:53.545390 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:53.570462 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.572547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.573617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.575241 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.576324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.577318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.755793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4059bc69-312c-43cb-9acf-00182e81a98c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d/action" status: 202 len: 0 microversion: 2.1 time: 0.503240 Sep 07 13:34:53.762058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 114/227] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:34:53 2022] POST /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:34:53.784369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:53.785409 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:53.797806 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.798460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.799451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.801074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.802016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.802885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:54.472186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:54.472186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-62f3bd4f-f583-41da-b79d-bfd8bee6da47 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1510 microversion: 2.1 time: 0.442299 Sep 07 13:34:54.472186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 115/228] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:53 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:54.472186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:54.474101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:54.474101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:54.474101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:54.474101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:54.478556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:54.478556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:54.478556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:54.478556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lazy-loading 'flavor' on Instance uuid 78d77c88-2507-41f1-a8bf-604880929568 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:34:55.289967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e7ed2fde-3e46-4a54-84ae-10d3bb5682a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/action" status: 202 len: 0 microversion: 2.20 time: 1.041737 Sep 07 13:34:55.289967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 116/229] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 7 13:34:54 2022] POST /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/action => generated 0 bytes in 1064 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:34:55.295312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-980a25e8-1817-4859-b5c6-135bad80832a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:55.296610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-980a25e8-1817-4859-b5c6-135bad80832a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:55.327784 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2a34e662-f2c0-406c-ad06-6b420def948e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.790110 Sep 07 13:34:55.340410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 114/230] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:34:53 2022] POST /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 194 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:55.369359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:55.373099 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:55.404904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.406331 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.407370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.410285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.412172 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.424611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.550614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-980a25e8-1817-4859-b5c6-135bad80832a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:55.576621 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-980a25e8-1817-4859-b5c6-135bad80832a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1216 microversion: 2.1 time: 0.290608 Sep 07 13:34:55.597191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 117/231] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:55 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1216 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:55.608107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:55.612524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:55.626043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.626919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.627752 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.629437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.630375 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.631100 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.728334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:55.740922 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0a95aaee-8d75-43d3-9bf3-03d86ca5441d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1325 microversion: 2.1 time: 0.398134 Sep 07 13:34:55.741860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 115/232] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:55 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1325 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:55.749279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:55.750309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:55.757944 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.759253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.759966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.760881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.761582 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.762225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.940470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:55.952965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6846916b-920d-4491-913d-7236eb16c6d1 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1510 microversion: 2.1 time: 0.353820 Sep 07 13:34:55.954101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 118/233] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:55 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:55.964508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:55.973488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:55.975404 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:55.977226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3d653bcf-8317-4348-bfe8-b8cc94087b23 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.232995 Sep 07 13:34:55.978601 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 116/234] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:34:55 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:34:56.619356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:56.626421 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:56.627531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:56.628043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:56.628492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:56.629234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:56.629703 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:56.630203 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:56.713684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:56.725939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1bab4491-2dc4-4372-863e-46f6521aea83 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1220 microversion: 2.1 time: 0.111327 Sep 07 13:34:56.730004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 119/235] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:56 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:56.782605 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:56.784070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:56.788857 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:56.798447 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:56.799480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:56.800412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:56.801697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:56.802523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:56.803338 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.001858 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:57.003260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:57.017144 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:57.018086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:57.018920 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.020333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:57.021201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:57.022004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.030661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:57.045767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5d37268a-bb19-4fc9-a2f4-a9ecc3e1c324 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.270900 Sep 07 13:34:57.046885 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 117/236] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:56 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:57.056511 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:57.057903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:57.070935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:57.071883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:57.072884 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.074234 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:57.075282 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:57.076091 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.297425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:57.310535 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ee6ac888-dbcc-4165-9ea8-85174234d905 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1510 microversion: 2.1 time: 0.317791 Sep 07 13:34:57.311227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 120/237] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:56 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:57.331844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:57.370074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:57.381131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:57.384164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ee1ca7f7-7365-4e22-92d6-89720fb81e7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.334626 Sep 07 13:34:57.385222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 118/238] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:34:57 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:34:57.755520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:57.757178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:57.770036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:57.771370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:57.773041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.774215 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:57.775275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:57.775926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.892998 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:57.903194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-989deb7d-d1c8-4719-9b28-c0463610eb6e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1220 microversion: 2.1 time: 0.153844 Sep 07 13:34:57.904388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 121/239] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:57 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:58.087033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:58.088683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:58.101488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.103369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.104662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.105904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.106757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.107570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.344002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:58.346272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:58.367976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.367976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.367976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.371206 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.372683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.373924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.395320 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:58.417101 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-34080ab3-998b-49b6-92e0-0c768abdbfad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.337981 Sep 07 13:34:58.419303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 119/240] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:58 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:58.455031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:58.456527 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:58.472429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.475434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.475434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.488491 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.489117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.489853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.742071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:58.762385 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:58.766008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:58.768953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1823a549-559f-4d3a-a571-81f8b4fb873b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.334377 Sep 07 13:34:58.770049 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 120/241] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:34:58 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:34:58.782618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:58.793691 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1531bdbf-54af-48e3-9961-c0f0f1a80b67 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1510 microversion: 2.1 time: 0.459688 Sep 07 13:34:58.807022 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 122/242] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:58 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:58.933965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:58.935225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:58.948079 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.948965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.949741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.950951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.951791 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.952485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.032165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-79ab5457-27be-49d7-850e-be54606ad596 req-ff7cafd2-9370-4a8e-a078-ac749e4042f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c03f54-ee87-44e6-827c-f8206c9e8792", "tag": "d260569e-ed83-4171-8a04-6f13aa7312e8"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:59.051784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-79ab5457-27be-49d7-850e-be54606ad596 req-ff7cafd2-9370-4a8e-a078-ac749e4042f2 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.052311 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-79ab5457-27be-49d7-850e-be54606ad596 req-ff7cafd2-9370-4a8e-a078-ac749e4042f2 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.052728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-79ab5457-27be-49d7-850e-be54606ad596 req-ff7cafd2-9370-4a8e-a078-ac749e4042f2 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.075111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-79ab5457-27be-49d7-850e-be54606ad596 req-ff7cafd2-9370-4a8e-a078-ac749e4042f2 service nova] Creating event network-changed:d260569e-ed83-4171-8a04-6f13aa7312e8 for instance 74c03f54-ee87-44e6-827c-f8206c9e8792 on hv-cinder-85625 Sep 07 13:34:59.081170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-79ab5457-27be-49d7-850e-be54606ad596 req-ff7cafd2-9370-4a8e-a078-ac749e4042f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052669 Sep 07 13:34:59.082623 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 123/243] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:34:59.103816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:59.120378 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9fb1a802-2a5b-4f3d-bd88-32b83b332535 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1268 microversion: 2.1 time: 0.194198 Sep 07 13:34:59.121176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 121/244] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:58 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:59.461713 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:59.462648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:59.469922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.470760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.471240 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.472079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.472477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.473043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.665693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:59.678716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1329c534-849b-472e-95ee-656719973739 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.222293 Sep 07 13:34:59.679345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 124/245] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:59 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:59.843589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:59.844214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:59.850305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:59.851148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:59.866488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.866488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.869458 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.869458 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.869458 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.870567 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.871397 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.872173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.875493 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.877075 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.878164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.879382 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:00.154580 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:00.165619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4dce99ba-c286-4769-b666-97f1e321df04 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1510 microversion: 2.1 time: 0.326883 Sep 07 13:35:00.184056 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 122/246] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:59 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:00.190065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:00.190832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:00.200232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:00.200750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:00.201405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:00.202151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:00.202619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:00.203104 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:00.223316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:00.297350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:00.307829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b5384288-0d8e-4400-899f-85369ca672a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1268 microversion: 2.1 time: 0.121846 Sep 07 13:35:00.308645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 123/247] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:00 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1268 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:00.329142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:00.338888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:00.340401 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:00.342148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-005bb474-d4ba-4069-9ab6-4dc6db1bd674 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.497641 Sep 07 13:35:00.343003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 125/248] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:34:59 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:00.708974 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:00.710028 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:00.721862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:00.722702 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:00.723520 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:00.724781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:00.725626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:00.726379 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:00.948198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:00.963991 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0ee1888c-1754-4097-b29e-dab88a145bbf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.262168 Sep 07 13:35:00.965076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 124/249] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:00 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:01.216875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:01.218569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:01.232191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.233076 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.234071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.235430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.236466 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.237262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.336506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:01.337656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:01.344880 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.345385 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.345827 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.346600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.347106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.347541 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.443055 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:01.451894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:01.455250 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d6f29a15-42c3-4864-a90d-e5052b5f5ad6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1268 microversion: 2.1 time: 0.123992 Sep 07 13:35:01.456236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 125/250] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:01 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1268 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:01.465005 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:01.466116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:01.466390 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-98e2ce2d-62a3-411c-b91b-4317fb441044 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1510 microversion: 2.1 time: 0.256782 Sep 07 13:35:01.467595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 126/251] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:01 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:01.484452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.485323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.486013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.487096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.487694 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.488460 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.664882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:01.674468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:01.676074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:01.677269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-174adff7-62e6-465a-a81e-09db8dced383 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.219770 Sep 07 13:35:01.677832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 126/252] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:01 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:02.009155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:02.009967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:02.017135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.017629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.018072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.018786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.019283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.019704 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.186216 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:02.194595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-df20452f-139b-4b4c-91fd-0576be76308f tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.191994 Sep 07 13:35:02.195232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 127/253] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:02 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:02.488935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:02.492944 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:02.498783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:02.503477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:02.509956 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.510963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.511786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.511975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.512545 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.513071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.513182 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.513958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.514118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.514473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.514721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.514965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.545141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:02.631991 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:02.645510 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8ad52621-2797-4007-961f-2b4f941c87de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1268 microversion: 2.1 time: 0.164837 Sep 07 13:35:02.646568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 127/254] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:02 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:02.705478 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:02.706269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:02.715705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.716374 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.716954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.718169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.718938 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.719685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.722929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:02.736393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-adb0a540-60ea-4e62-8548-859d782118c5 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1510 microversion: 2.1 time: 0.246790 Sep 07 13:35:02.737980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 128/255] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:02 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:02.901689 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:02.921111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:02.925161 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:02.927545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bcf9e00f-af4c-43c4-9fda-a41630320b60 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.227406 Sep 07 13:35:02.935185 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 128/256] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:02 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:03.223403 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:03.224499 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:03.234044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:03.234904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:03.235517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:03.236777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:03.237581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:03.238376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:03.426517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:03.467142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-42975682-4808-44ce-bfc6-bd0338f1bbe3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.247920 Sep 07 13:35:03.467142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 129/257] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:03 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:03.692380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:03.698285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:03.704330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=4 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:03.709378 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=18 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:03.734511 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:03.735507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:03.736350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:03.737962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:03.739127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:03.739978 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:03.775524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:03.779241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:03.809122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:03.815146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:03.816436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:03.821853 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:03.824910 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:03.829721 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:04.007579 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:04.025604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b0a8f0f4-9d40-4ea8-9389-cac6b45b01ee tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1268 microversion: 2.1 time: 0.340646 Sep 07 13:35:04.042172 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 129/258] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:03 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1268 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:04.061841 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:04.062405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:04.078787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:04.079319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:04.080120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:04.081073 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:04.081836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:04.082654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:04.188340 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:04.198495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e503298a-4fa4-4965-96af-3b23f585206f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1516 microversion: 2.1 time: 0.436706 Sep 07 13:35:04.211391 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 130/259] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:03 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1516 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:04.355162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:04.355162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:04.355701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:04.355701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fb393ae5-4424-4f0f-b2fa-a60052cfe51b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.309509 Sep 07 13:35:04.355701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 130/260] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:04 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:04.505173 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:04.509437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:04.517248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:04.518247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:04.519212 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:04.520451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:04.521187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:04.521797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:04.799354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:04.818294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5e9dc015-b62d-4c9c-969d-162dbe7d989c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.318844 Sep 07 13:35:04.819395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 131/261] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:04 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:05.078242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:05.079159 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:05.093188 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.093409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.094871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.109806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.109806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.111091 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.378762 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4203bd08-c24f-4f48-a761-97b9eee557f6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:05.394578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:05.406736 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4203bd08-c24f-4f48-a761-97b9eee557f6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.408312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4203bd08-c24f-4f48-a761-97b9eee557f6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.410313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-086ad636-e9a7-40c0-89da-3917b67125f9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1276 microversion: 2.1 time: 0.339634 Sep 07 13:35:05.412176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4203bd08-c24f-4f48-a761-97b9eee557f6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.412675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 131/262] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:05 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1276 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:05.443230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:05.443230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:05.465063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.466074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.467396 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.472404 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.474528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.495536 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.575694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:05.669686 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4203bd08-c24f-4f48-a761-97b9eee557f6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Going to try to stop instance {{(pid=151551) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:35:05.887954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:05.904403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:05.907922 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:05.910150 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-da3cb9a4-0d50-48a5-aa06-d9c997a55f39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.494196 Sep 07 13:35:05.911230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 132/263] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:05 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:05.924272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:05.935151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:05.946405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.947203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.947747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.948650 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.949213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.949706 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.222829 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4203bd08-c24f-4f48-a761-97b9eee557f6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action" status: 202 len: 0 microversion: 2.1 time: 0.849232 Sep 07 13:35:06.223670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 132/264] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:35:05 2022] POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:35:06.248365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:06.248365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:06.260531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.262325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.263464 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.265417 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.267077 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.268550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.312260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:06.324600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-581910c4-134a-4de5-ae84-ec782a1526b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.411314 Sep 07 13:35:06.325798 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 133/265] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:05 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:06.478397 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:06.480116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:06.492870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.494055 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.494898 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.496744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.499731 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.501895 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.577009 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:06.599780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ac352fa4-87bf-4036-9463-b8d9d18ae297 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.361912 Sep 07 13:35:06.602441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 133/266] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:06 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:06.660449 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:06.682104 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3768b630-6c0f-42c5-8074-22971c0d0ec0 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1274 microversion: 2.1 time: 0.210934 Sep 07 13:35:06.690533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 134/267] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:06 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:06.708013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6f298a83-a194-448e-9ff3-c2ca40689b7f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'create', calling method: .version_select at 0x7f1747ecdc10>, body: {"keypair": {"name": "tempest-keypair-456826461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgqagbtEhGH+Fj6K2OK6VVV9cEjaIigRhSwvTTAbF7+C2MEsuDe4hR783cMoEC7nNTr7fIuc5Aie87Vd9trMiYi9+I6C7hmfkAwN0rbBWCJGdDdV7rGUAx8Nf2zcvhPLA=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:06.736208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-6f298a83-a194-448e-9ff3-c2ca40689b7f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:06.744321 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-6f298a83-a194-448e-9ff3-c2ca40689b7f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for user a145e63a44db43acafc92bb2a238f463 and project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:06.909993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6f298a83-a194-448e-9ff3-c2ca40689b7f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209310 Sep 07 13:35:06.911090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 134/268] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:35:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:06.952607 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:06.954213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:06.961816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.969366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.969366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.969366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.969366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.970023 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.386093 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:07.394672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:07.439787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.440865 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.441699 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.443186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.444028 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.444812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.474394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:07.505983 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:07.511238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:07.515315 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fbf6fb0c-be2e-490f-b055-a27867075bed tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.570072 Sep 07 13:35:07.516537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 135/269] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:06 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:07.687551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:07.688586 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:07.701885 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.703236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.704369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.707230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.707632 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.708768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.905392 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:07.951617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1ee964e4-8fd3-41b5-9193-5038260b1797 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.590040 Sep 07 13:35:07.953594 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 135/270] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:07 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:07.965938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:07.967644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:07.977894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.977894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.977894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.977894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.991104 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.991104 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:08.259183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:08.282576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f8cb4b14-008e-4b2d-ac3d-406299e391b7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.607188 Sep 07 13:35:08.285245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 136/271] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:07 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:08.306324 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:08.325394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2138564a-60ad-4b22-96d4-b4ab895741a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.369093 Sep 07 13:35:08.326706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 136/272] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:07 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:08.557706 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:08.558460 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:08.569285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:08.570336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:08.571072 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:08.572724 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:08.573973 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:08.574787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:08.998420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:08.999883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:09.011039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:09.012185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:09.013083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:09.014105 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:09.014695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:09.016803 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:09.039333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:09.054823 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:09.058904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:09.060819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-246e3876-d44e-478c-b834-c40fb2cb0c03 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.507684 Sep 07 13:35:09.061316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 137/273] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:08 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:09.327453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:09.329740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:09.343714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:09.344928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:09.346117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:09.347757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:09.352778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:09.355139 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:09.374141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:09.389059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-928f529a-3c30-47bf-a656-880a131028cb tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.399701 Sep 07 13:35:09.391233 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 137/274] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:08 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:09.400494 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:09.405559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:09.414040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:09.415427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:09.416293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:09.416861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:09.418116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:09.418880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:09.767887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:09.796459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f088b666-98ae-499b-881b-7291089e70da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.476944 Sep 07 13:35:09.808161 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 138/275] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:09 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:09.817513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:09.837189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c8494c65-1acf-461c-a8cc-8aff812e2f96 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.436597 Sep 07 13:35:09.843655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 138/276] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:09 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:10.021456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-9a311e99-ce2b-4a45-b649-6550592446d2 req-259d97a6-8712-4f40-a585-784a45338da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57347a10-9415-44b7-a4e0-d588355cc98f", "tag": "20121b11-8f66-48fb-a5f4-2672fc1e6d0c"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:10.043387 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-9a311e99-ce2b-4a45-b649-6550592446d2 req-259d97a6-8712-4f40-a585-784a45338da4 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.048978 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-9a311e99-ce2b-4a45-b649-6550592446d2 req-259d97a6-8712-4f40-a585-784a45338da4 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.048978 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-9a311e99-ce2b-4a45-b649-6550592446d2 req-259d97a6-8712-4f40-a585-784a45338da4 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.067152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-9a311e99-ce2b-4a45-b649-6550592446d2 req-259d97a6-8712-4f40-a585-784a45338da4 service nova] Creating event network-changed:20121b11-8f66-48fb-a5f4-2672fc1e6d0c for instance 57347a10-9415-44b7-a4e0-d588355cc98f on hv-cinder-85625 Sep 07 13:35:10.080314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-9a311e99-ce2b-4a45-b649-6550592446d2 req-259d97a6-8712-4f40-a585-784a45338da4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065211 Sep 07 13:35:10.082029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 139/277] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:10.106873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:10.108682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:10.121700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.122266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.122770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.123767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.124244 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.124681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.415898 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:10.428944 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:10.429214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:10.432085 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:10.435460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:10.437853 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1a3f251d-e067-46b4-b62b-8a661c196f12 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.336677 Sep 07 13:35:10.438891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 139/278] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:10 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:10.439431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.440087 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.441058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.442809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.444017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.445616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.831753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:10.834240 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:10.851687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.852522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.853297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.854833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.856135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.857052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:11.084176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:11.089118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:11.098871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bcfd91c5-ad8c-4f5f-ba49-b40dba7345e6 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.678314 Sep 07 13:35:11.114245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 140/279] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:10 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:11.114245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:11.114245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:11.125329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:11.126183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:11.127157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:11.128781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:11.130006 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:11.131170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:11.131657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:11.171348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c24526ea-f143-4e5e-b3dd-9ac43e5f825f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.346533 Sep 07 13:35:11.177135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 140/280] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:10 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:11.413083 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:11.431522 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dc58de32-fb9c-4799-8710-08593dda95be tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.329500 Sep 07 13:35:11.432529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 141/281] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:11 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:11.494695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:11.497989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:11.522166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:11.528408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:11.529685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:11.535098 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:11.536137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:11.536967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.108889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:12.128627 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:12.130788 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:12.133586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a160bc34-d216-4e5b-a84b-eb1ddb495794 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.646078 Sep 07 13:35:12.136476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 141/282] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:11 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:12.152689 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:12.154226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:12.163225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.164622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.165231 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.166232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.167195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.168153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.221135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:12.222206 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:12.239009 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.245718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.248763 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.252532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.253793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.254804 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.589953 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:12.603658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-349c5c52-72b0-440e-8404-4c5615451bff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.388818 Sep 07 13:35:12.604709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 142/283] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:12 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:12.610256 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-4aeabce7-7642-4ee5-a146-1219426c42f2 req-a6dbc889-5925-48e1-b523-9d3ffaa27905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c03f54-ee87-44e6-827c-f8206c9e8792", "name": "network-vif-plugged", "status": "completed", "tag": "d260569e-ed83-4171-8a04-6f13aa7312e8"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:12.625837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4aeabce7-7642-4ee5-a146-1219426c42f2 req-a6dbc889-5925-48e1-b523-9d3ffaa27905 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.625837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4aeabce7-7642-4ee5-a146-1219426c42f2 req-a6dbc889-5925-48e1-b523-9d3ffaa27905 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.625837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4aeabce7-7642-4ee5-a146-1219426c42f2 req-a6dbc889-5925-48e1-b523-9d3ffaa27905 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.646801 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-4aeabce7-7642-4ee5-a146-1219426c42f2 req-a6dbc889-5925-48e1-b523-9d3ffaa27905 service nova] Creating event network-vif-plugged:d260569e-ed83-4171-8a04-6f13aa7312e8 for instance 74c03f54-ee87-44e6-827c-f8206c9e8792 on hv-cinder-85625 Sep 07 13:35:12.658464 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-4aeabce7-7642-4ee5-a146-1219426c42f2 req-a6dbc889-5925-48e1-b523-9d3ffaa27905 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052000 Sep 07 13:35:12.659843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 143/284] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:12.684870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1452059258", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e5113d0-24ef-406d-8c1a-7899200f3372"}], "security_groups": [{"name": "tempest-securitygroup--1172166634"}], "key_name": "tempest-keypair-456826461", "user_data": "}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:12.721982 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:12.741821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-890300c6-fd0e-4743-8e70-7a39b4102032 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.596701 Sep 07 13:35:12.751651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 142/285] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:12 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:12.765675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:12.767811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:12.778701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.780249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.780500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.781914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.782913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.783778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.912501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] validate_networks() for [('3e5113d0-24ef-406d-8c1a-7899200f3372', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:35:13.035434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:13.057545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-96e9032c-61de-4525-9a73-4ffce5913bf3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.301982 Sep 07 13:35:13.059575 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 143/286] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:12 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:13.090930 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ca23d25c-a699-4d17-9052-83fbfe959504 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: .version_select at 0x7f1747eaddc0>, body: {"keypair": {"name": "tempest-keypair-142890716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAslpMCFZyctiQ+YFgvUyXgEi0JHcxalp0YNm2M2j0vqN76F0jZuppcdKmGXCIBfr1B6rzici5JmOQkZA+DoY3mCmHFVcQ79WR+3pqDO/yrXYRf2dJ/3GH0Qx8/G7O+c+Q=="}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:13.128497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-ca23d25c-a699-4d17-9052-83fbfe959504 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:13.138205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-ca23d25c-a699-4d17-9052-83fbfe959504 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:13.286273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ca23d25c-a699-4d17-9052-83fbfe959504 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.223305 Sep 07 13:35:13.302853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 144/287] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:35:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:13.319483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:13.319483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:13.330582 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.331621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.332421 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.335311 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.339151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.340589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.682955 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:13.701687 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:13.705319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:13.707779 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2b7e4bef-057c-4fc0-8504-9ee299195211 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1746 microversion: 2.20 time: 0.402924 Sep 07 13:35:13.709609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 145/288] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:13 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1746 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:13.724114 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:13.725573 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:13.727341 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:35:13.729962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:35:13.731285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:35:13.732439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:35:13.733329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:35:13.740088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.740726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.742192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.743786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.744708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.745262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.753939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.758527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.758527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.758527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.759189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.760071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.799402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:13.805085 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Getting quotas for user a145e63a44db43acafc92bb2a238f463 and project 1070aeddb0d544f4b3b4c1e41979944d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:13.821397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:35:13.824071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:35:14.041446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-62011d2a-808c-4271-aa24-5dd8a1e2d40e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.378884 Sep 07 13:35:14.043286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 144/289] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:35:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:35:14.074459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:14.074459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:14.091029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:14.092295 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:14.093102 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:14.095805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:14.096672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:14.097600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:14.123149 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:14.136278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ad2929b7-c0f7-44d8-a9d2-a34a4d2c78aa tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.424049 Sep 07 13:35:14.137606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 146/290] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:13 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:14.143235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0f9c331c-7fce-4aa1-8597-eaaa4572a5bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:14.144286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0f9c331c-7fce-4aa1-8597-eaaa4572a5bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:14.216836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0f9c331c-7fce-4aa1-8597-eaaa4572a5bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:14.225249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0f9c331c-7fce-4aa1-8597-eaaa4572a5bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1245 microversion: 2.1 time: 0.086154 Sep 07 13:35:14.226819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 147/291] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:14 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:14.232029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:14.232987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:14.241035 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:14.241890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:14.242621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:14.243555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:14.244176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:14.244790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:14.515393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:14.532600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f7857479-d35f-4210-b036-9cbb1897868a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.472932 Sep 07 13:35:14.537227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 145/292] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:14 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:14.759525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:14.768679 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:14.770378 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:14.777939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-84b8b4e7-5739-4a26-b521-8c1181df3b6a tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.549798 Sep 07 13:35:14.779154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 148/293] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:14 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:14.787138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:14.793044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:14.793044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:14.793044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:14.793044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:14.793520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:14.815789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:15.000812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:15.017459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:15.020525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:15.022416 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cccc4164-4524-49f4-974a-f7b6b34ec5bb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1746 microversion: 2.20 time: 0.260698 Sep 07 13:35:15.025422 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 146/294] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:14 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1746 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:15.187441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:15.188070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:15.196435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.197153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.197789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.199063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.199858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.200726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.283513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8d1635dd-9cc5-44ef-bfb7-e3ed8d77b609 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:15.284562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8d1635dd-9cc5-44ef-bfb7-e3ed8d77b609 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:15.288821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:15.385159 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8d1635dd-9cc5-44ef-bfb7-e3ed8d77b609 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:15.394754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8d1635dd-9cc5-44ef-bfb7-e3ed8d77b609 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1245 microversion: 2.1 time: 0.118042 Sep 07 13:35:15.395887 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 147/295] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:15 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:15.563265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:15.573902 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-42a5a93e-a27a-4e81-bda7-a9e5a81dc7e7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.391994 Sep 07 13:35:15.574482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 149/296] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:15 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:15.599785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:15.601016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:15.612326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.612981 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.613319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.614059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.614525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.615007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.829113 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:15.831814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:15.869490 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.873412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.876333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.881373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.883209 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.889735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.957223 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:15.983578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ffa493ce-f935-4b5f-967a-36f0a6de09ac tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1313 microversion: 2.1 time: 0.392318 Sep 07 13:35:15.984698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 148/297] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:15 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:16.066260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:16.068969 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:16.082473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.089479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.089479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.089479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.089479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.090070 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.189562 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:16.200312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-03d9991f-3038-4abc-afc3-af7ebea7a37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.390156 Sep 07 13:35:16.201184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 150/298] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:15 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:16.393753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:16.405617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:16.407410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:16.409082 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b2689996-c024-498e-8d1e-d3281d818118 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1746 microversion: 2.20 time: 0.351639 Sep 07 13:35:16.410294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 149/299] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:16 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1746 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:16.440121 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:16.441421 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:16.454145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.455313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.456118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.457788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.458615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.459583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.620694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:16.627613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:16.630420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:16.638703 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.643284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.643284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.643284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.644089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.644818 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.653667 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-efd0f013-45c0-4b6c-bf01-6d959f216ca0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1241 microversion: 2.1 time: 0.218396 Sep 07 13:35:16.670358 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 151/300] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:16 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:16.918072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:16.930166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0fb36130-6bbd-4b28-9b3c-f0892be9be92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.318050 Sep 07 13:35:16.931234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 150/301] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:16 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:17.028377 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:17.029519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:17.044125 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.045012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.046203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.047525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.048374 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.049141 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.230791 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:17.231700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:17.242967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.243885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.244510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.245481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.246041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.246723 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.393676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:17.418257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d85bafe9-1118-4144-ad09-bc687f9e26cf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1496 microversion: 2.1 time: 0.397740 Sep 07 13:35:17.420053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 152/302] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:17 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1496 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:17.463075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:17.468128 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:17.490174 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.493587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.496875 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.502249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.503082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.504075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.859203 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:17.879512 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f550292e-1c15-4b10-a467-0d30468a2bfb tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.656105 Sep 07 13:35:17.881563 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 151/303] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:17 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:17.912525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:17.914766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:17.928336 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.930923 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:17.936765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.937532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.939010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.940271 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.941030 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.943628 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:17.946819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:17.950870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b055c6b3-61a2-4f4a-9624-3e7cf8c614a3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.497391 Sep 07 13:35:17.950870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 153/304] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:17 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:17.984844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:17.987803 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:17.995553 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.996092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.996693 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.997445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.998262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.998805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:18.170389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:18.216170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-edf89c2a-1550-4ed9-976d-48484b3ecd0a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1297 microversion: 2.1 time: 0.331516 Sep 07 13:35:18.259069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 152/305] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:17 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1297 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:18.396275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1932959", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834c0-0dea-41cd-83a3-dc66b7dd2f54"}], "security_groups": [{"name": "tempest-securitygroup--292833671"}], "key_name": "tempest-keypair-142890716", "user_data": "}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:18.547510 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:18.570129 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-20d19c96-230a-4801-a438-8944cb0a3abb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.597738 Sep 07 13:35:18.582283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 154/306] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:17 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:18.716896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] validate_networks() for [('6b6834c0-0dea-41cd-83a3-dc66b7dd2f54', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:35:18.921626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:18.922690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:18.934541 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:18.935856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:18.936647 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:18.937934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:18.939067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:18.939847 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:19.268594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:19.297587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f945efb4-a090-449e-8185-6c7db7d2f046 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.384202 Sep 07 13:35:19.298862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 155/307] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:18 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:19.318401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:19.319157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:19.328211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:19.332259 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:19.332777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:19.333547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:19.334781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:19.335234 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:19.631751 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:35:19.633134 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:35:19.633977 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:35:19.634578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:35:19.635214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:35:19.648602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:19.654147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:19.654147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:19.654147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:19.655166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:19.655903 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:19.698394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:19.706150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:19.778160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:35:19.793444 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:35:19.941349 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:19.959412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:19.961566 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:19.966819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fce01dda-6d74-4183-9576-b51d60cb4c5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.663923 Sep 07 13:35:19.967560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 156/308] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:19 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:19.973748 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:19.974377 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:19.981554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:19.982189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:19.982705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:19.983762 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:19.988379 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:19.988933 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:20.020842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-80312063-f110-40c9-8808-5d9d27fae085 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.636936 Sep 07 13:35:20.023533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 153/309] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:35:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:35:20.055991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:20.062546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:20.094228 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:20.097408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:20.100597 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:20.105173 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:20.106016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:20.108827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:20.237944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:35:20.369059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:20.369059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b129214f-4467-4372-9907-1ed25eccb2d9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1315 microversion: 2.1 time: 0.399287 Sep 07 13:35:20.371991 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 157/310] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:19 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:20.381963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:20.384848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:20.412372 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:20.414504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:20.415614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:20.416697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:20.417495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:20.418700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:20.990820 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7bd284d3-82f9-4745-9c3c-37750387611c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "DELETE /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 204 len: 0 microversion: 2.1 time: 0.962576 Sep 07 13:35:20.993634 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 154/311] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:35:20 2022] DELETE /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 0 bytes in 969 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:35:20.994385 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:21.024278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b2620690-3798-4c4e-9b82-ae335edd75a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:21.031115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b2620690-3798-4c4e-9b82-ae335edd75a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:21.040568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c6432401-ee68-4661-be0d-0829c06d58d8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.665717 Sep 07 13:35:21.087808 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 158/312] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:20 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:21.093545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:21.099036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:21.122304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.124764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.129570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.133807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.134856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.139508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b2620690-3798-4c4e-9b82-ae335edd75a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:21.139981 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.162353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b2620690-3798-4c4e-9b82-ae335edd75a5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1238 microversion: 2.1 time: 0.165175 Sep 07 13:35:21.164169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 155/313] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:20 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1238 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:21.186877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-cc277475-a77d-4d44-81af-426c4b260af6 req-a5baf2b0-05f6-4a78-9eb2-0551a441b6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57347a10-9415-44b7-a4e0-d588355cc98f", "name": "network-vif-plugged", "status": "completed", "tag": "20121b11-8f66-48fb-a5f4-2672fc1e6d0c"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:21.202013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-cc277475-a77d-4d44-81af-426c4b260af6 req-a5baf2b0-05f6-4a78-9eb2-0551a441b6ab service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.203050 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-cc277475-a77d-4d44-81af-426c4b260af6 req-a5baf2b0-05f6-4a78-9eb2-0551a441b6ab service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.204901 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-cc277475-a77d-4d44-81af-426c4b260af6 req-a5baf2b0-05f6-4a78-9eb2-0551a441b6ab service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.208279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:21.225111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-cc277475-a77d-4d44-81af-426c4b260af6 req-a5baf2b0-05f6-4a78-9eb2-0551a441b6ab service nova] Creating event network-vif-plugged:20121b11-8f66-48fb-a5f4-2672fc1e6d0c for instance 57347a10-9415-44b7-a4e0-d588355cc98f on hv-cinder-85625 Sep 07 13:35:21.237621 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-cc277475-a77d-4d44-81af-426c4b260af6 req-a5baf2b0-05f6-4a78-9eb2-0551a441b6ab service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070857 Sep 07 13:35:21.238687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 156/314] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:21.250700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:21.251896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:21.270465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.271285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.271783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.276523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.277170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.277964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.583940 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:21.596282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-476825c3-3874-4288-aca2-8ba89db03916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1502 microversion: 2.1 time: 0.356027 Sep 07 13:35:21.597800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 157/315] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:21 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1502 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:21.604179 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:21.604902 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:21.618700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.630919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.630919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.630919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.630919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.631567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.704349 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:21.717106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-501003d7-78b4-4808-b692-9b5899f2c659 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.644011 Sep 07 13:35:21.717700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 159/316] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:21 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:21.727560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:21.728809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:21.745084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.746099 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.746763 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.748145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:21.749009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:21.749786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:21.893651 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:21.905965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:21.907603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:21.908866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5204dcbe-8f71-4415-b8c1-4cf244784f0d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.309970 Sep 07 13:35:21.909439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 158/317] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:21 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:21.996248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:22.019935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f9646699-e639-40c7-89c6-9ee905a14c98 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1303 microversion: 2.1 time: 0.300308 Sep 07 13:35:22.021145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 160/318] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:21 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1303 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:22.101728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:22.103011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:22.136163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.137460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.138350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:22.139776 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.140716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.141504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:22.218183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:22.220029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:22.222400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:22.240027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.245278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.245956 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:22.249419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.250738 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.258800 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:22.456860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:22.482532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-68d86e68-b372-497a-bf42-2548c9dbe87d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.389152 Sep 07 13:35:22.499979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:22.508104 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 159/319] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:22 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:22.520229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9f2000c7-b883-4a44-8979-619d9a73ebe5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1242 microversion: 2.1 time: 0.322157 Sep 07 13:35:22.543343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 161/320] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:22 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1242 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:22.639436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:22.639436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:22.641270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.642284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.644413 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:22.646098 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.647367 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.648162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:22.745636 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:22.759492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:22.777712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.778569 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.779112 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:22.779867 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:22.780359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:22.780838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:23.021481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:23.033618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-01720c45-64a2-41ac-b2f5-a7e4444df446 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1502 microversion: 2.1 time: 0.412037 Sep 07 13:35:23.054962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 160/321] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:22 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:23.061621 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:23.062491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:23.071911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:23.079996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:23.079996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:23.079996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:23.079996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:23.080359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:23.654953 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:23.676386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:23.692589 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:23.720133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fd3739eb-d800-48c4-83a3-2dd189522c87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.663238 Sep 07 13:35:23.724516 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 161/322] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:23 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:23.762993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:23.763912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:23.774435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:23.781151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:23.784614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:23.788137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:23.792538 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:23.794062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:23.979000 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:23.989413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5578120c-d630-43b4-ac6c-bb6ce00f215b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 1.248656 Sep 07 13:35:23.990433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 162/323] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:22 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:24.018320 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-de4aee68-d052-4956-bfb3-a7991ca7d7b8 req-897ea209-2a35-4922-a8ad-e45dd2b073cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d77c88-2507-41f1-a8bf-604880929568", "name": "network-vif-plugged", "status": "completed", "tag": "dbb94b1d-c06e-4515-a9ea-b00bd9245f9d"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:24.047348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-de4aee68-d052-4956-bfb3-a7991ca7d7b8 req-897ea209-2a35-4922-a8ad-e45dd2b073cc service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.048173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-de4aee68-d052-4956-bfb3-a7991ca7d7b8 req-897ea209-2a35-4922-a8ad-e45dd2b073cc service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.048811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-de4aee68-d052-4956-bfb3-a7991ca7d7b8 req-897ea209-2a35-4922-a8ad-e45dd2b073cc service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.065471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-de4aee68-d052-4956-bfb3-a7991ca7d7b8 req-897ea209-2a35-4922-a8ad-e45dd2b073cc service nova] Creating event network-vif-plugged:dbb94b1d-c06e-4515-a9ea-b00bd9245f9d for instance 78d77c88-2507-41f1-a8bf-604880929568 on hv-cinder-85625 Sep 07 13:35:24.077036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-de4aee68-d052-4956-bfb3-a7991ca7d7b8 req-897ea209-2a35-4922-a8ad-e45dd2b073cc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066670 Sep 07 13:35:24.078495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 163/324] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:24.086468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:24.087867 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:24.096282 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.097042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.097941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.098893 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.099739 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.100398 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.168951 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:24.192108 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5872c926-84eb-4ae6-9492-e8a7f922b477 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.464861 Sep 07 13:35:24.216943 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 162/325] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:23 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:24.227211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:24.229266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:24.246497 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.251964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.253154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.254581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.255477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.256480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.273819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=6 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:24.471392 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:24.499728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0b0584c0-46da-45f7-b085-1c0daeebd762 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1290 microversion: 2.1 time: 0.279632 Sep 07 13:35:24.500926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 163/326] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:24 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1290 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:24.512779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:24.513680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:24.524482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.535999 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.535999 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.538395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.538395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.538395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.852645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:24.866057 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b1f59773-cabd-4dda-b857-672fd8f4d0d3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.785997 Sep 07 13:35:24.871510 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 164/327] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:24 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:24.878694 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:24.886673 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:24.903298 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.904140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.904816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.905774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:24.906445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:24.907082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:24.924260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:24.928809 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:24.953866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6ab7784b-96d3-4cd3-b72f-2f355b53b0b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1502 microversion: 2.1 time: 0.447754 Sep 07 13:35:24.954570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 164/328] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:24 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1502 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:25.018528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:25.019251 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:25.041739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.048511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.048511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.048511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.048511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.049086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.339632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:25.352055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-45f25460-995d-49a4-9f9c-58f1617cc0f3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1316 microversion: 2.1 time: 0.340563 Sep 07 13:35:25.368558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 165/329] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:25 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:25.374017 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:25.375110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:25.375642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:25.389149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.389598 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.390058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.390801 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.391330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.391744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.393071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:25.394575 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:25.395862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1208a5fc-a4ec-4175-955c-29a398a8f887 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.522994 Sep 07 13:35:25.417369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 165/330] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:24 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:25.555982 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:25.556809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:25.574918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.577782 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.578751 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.580351 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.581873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.586205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.599167 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:25.627838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4000c94a-7bff-46e2-b63e-4d196534c488 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.265721 Sep 07 13:35:25.637437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 166/331] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:25 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:25.895307 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:25.914220 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:25.914905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:25.916074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0914ad91-ac70-430c-ba4b-db614c9e28f8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1290 microversion: 2.1 time: 0.369800 Sep 07 13:35:25.917381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 166/332] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:25 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1290 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:25.924393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.925259 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.925440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.926015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:25.926488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:25.927499 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:25.984988 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:25.986220 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:26.000289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.000289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.000289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.001787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.002635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.003419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.122129 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:26.133433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-813c4955-590e-4dca-9029-061a636b00af tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.229748 Sep 07 13:35:26.147060 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 167/333] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:25 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:26.147312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:26.147447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-6378e4c8-5e88-4a1c-b032-09af4ca3ef15 req-5a4aa1e6-ceae-4009-94ce-cd0f5c467f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c03f54-ee87-44e6-827c-f8206c9e8792", "name": "network-vif-deleted", "tag": "d260569e-ed83-4171-8a04-6f13aa7312e8"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:26.152661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bef7c581-a927-459b-8ff6-4bd8d883a514 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1460 microversion: 2.1 time: 0.173589 Sep 07 13:35:26.152661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 167/334] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:25 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1460 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:26.154395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-6378e4c8-5e88-4a1c-b032-09af4ca3ef15 req-5a4aa1e6-ceae-4009-94ce-cd0f5c467f91 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.155394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-6378e4c8-5e88-4a1c-b032-09af4ca3ef15 req-5a4aa1e6-ceae-4009-94ce-cd0f5c467f91 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.155949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-6378e4c8-5e88-4a1c-b032-09af4ca3ef15 req-5a4aa1e6-ceae-4009-94ce-cd0f5c467f91 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.172141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-6378e4c8-5e88-4a1c-b032-09af4ca3ef15 req-5a4aa1e6-ceae-4009-94ce-cd0f5c467f91 service nova] Creating event network-vif-deleted:d260569e-ed83-4171-8a04-6f13aa7312e8 for instance 74c03f54-ee87-44e6-827c-f8206c9e8792 on hv-cinder-85625 Sep 07 13:35:26.177770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-6378e4c8-5e88-4a1c-b032-09af4ca3ef15 req-5a4aa1e6-ceae-4009-94ce-cd0f5c467f91 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042336 Sep 07 13:35:26.178384 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 168/335] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:26.404427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:26.405189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:26.415897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.416975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.418529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.421158 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.422302 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.423395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.428679 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:26.429893 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:26.456852 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.457171 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.457623 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.458369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.485520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.486009 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.865603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:26.881478 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ad1869dc-ed72-4066-8363-c77bf75efaed tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1505 microversion: 2.1 time: 0.504007 Sep 07 13:35:26.883818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 168/336] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:26 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:26.902866 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:26.903693 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:26.912774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.914612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.915545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.916439 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:26.918084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:26.918679 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:26.985405 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:27.011255 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:27.013771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:27.015847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-50de33d1-7d22-4435-90a7-97f08a68f9b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.592495 Sep 07 13:35:27.017019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 169/337] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:26 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:27.032789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:27.033740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:27.050074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.051015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.051870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.053043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.053797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.054434 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.177794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:27.183369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3ba3ed34-87ca-4251-a6a5-2046250c2cb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1298 microversion: 2.1 time: 0.163555 Sep 07 13:35:27.184495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 170/338] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:27 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:27.190308 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:27.198968 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:27.215640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.216404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.216853 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.217588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.218051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.218479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.570771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:27.584135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fda646d1-9fd4-4939-8c84-71c4cb6fa7f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.397254 Sep 07 13:35:27.585615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 171/339] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:27 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:27.594149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:27.595750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:27.610359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.619234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.621784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.623057 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.626879 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.628953 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.711479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.713224 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.714486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.715870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid 74c03f54-ee87-44e6-827c-f8206c9e8792 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:35:27.832397 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:27.849301 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7c582137-b90b-41b6-aeab-a45bfd5488f0 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.959655 Sep 07 13:35:27.849815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:27.851359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 169/340] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:26 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:27.901370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-eda708e5-f6ff-4882-a729-1dd397d97adf tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1303 microversion: 2.1 time: 0.312753 Sep 07 13:35:27.904090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 172/341] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:27 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1303 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:28.053540 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:28.056013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:28.068780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.071523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.072246 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.073660 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.074346 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.075081 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.238880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:28.251435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:28.265557 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.268510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.269820 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.271611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.273501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.274603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.520465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:28.564290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2b559bef-8c95-45c9-81f7-f6cb0d9b6c02 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1296 microversion: 2.1 time: 0.337767 Sep 07 13:35:28.566683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 173/342] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:28 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1296 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:28.586738 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-73c9e714-3c04-4254-a8d5-b4bec940b3c1 req-4ecf872d-5976-4817-84c3-a8e3b9040da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42374ed7-b063-4892-b40a-da27fb0779ce", "tag": "024e4e3d-bd89-4219-9aa9-4e5be7865def"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:28.629058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-73c9e714-3c04-4254-a8d5-b4bec940b3c1 req-4ecf872d-5976-4817-84c3-a8e3b9040da2 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.629886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-73c9e714-3c04-4254-a8d5-b4bec940b3c1 req-4ecf872d-5976-4817-84c3-a8e3b9040da2 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.630638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-73c9e714-3c04-4254-a8d5-b4bec940b3c1 req-4ecf872d-5976-4817-84c3-a8e3b9040da2 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.678594 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-73c9e714-3c04-4254-a8d5-b4bec940b3c1 req-4ecf872d-5976-4817-84c3-a8e3b9040da2 service nova] Creating event network-changed:024e4e3d-bd89-4219-9aa9-4e5be7865def for instance 42374ed7-b063-4892-b40a-da27fb0779ce on hv-cinder-85625 Sep 07 13:35:28.698232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-73c9e714-3c04-4254-a8d5-b4bec940b3c1 req-4ecf872d-5976-4817-84c3-a8e3b9040da2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128934 Sep 07 13:35:28.700366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 174/343] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:28.709539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:28.711004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:28.752572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.753135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.756524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.757856 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.759136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.762366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.797530 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:28.818076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:28.823514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:28.828177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6ad74bfd-dcb3-4ae4-a58b-8f7b3f85d449 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.782412 Sep 07 13:35:28.830046 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 170/344] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:28 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:28.902860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:28.903966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:28.922260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.923024 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.923822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:28.927249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:28.928110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:28.929475 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.046156 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:29.096202 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c2b27bac-f144-496a-bc33-f3166bbcd4f0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.392256 Sep 07 13:35:29.101112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 175/345] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:28 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:29.113197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:29.114559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:29.126337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.127226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.128051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.129475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.130460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.131267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.217629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.218440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.219302 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.220683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid 74c03f54-ee87-44e6-827c-f8206c9e8792 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:35:29.323777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:29.352398 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-daf2958e-3eff-432d-91da-43bb021f4419 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1303 microversion: 2.1 time: 0.242755 Sep 07 13:35:29.369398 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 176/346] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:29 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1303 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:29.617709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:29.619389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:29.632814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.635219 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.636668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.638426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.645187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.647035 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.655906 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:29.667190 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fda3f6c7-ee11-4228-9a36-51822cc5280a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.769265 Sep 07 13:35:29.681907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 171/347] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:28 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:29.682884 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=4 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:29.803293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:29.813772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-da8ab45b-a2b3-4e3b-9873-2663cb88fa04 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1296 microversion: 2.1 time: 0.207291 Sep 07 13:35:29.814618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 177/348] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:29 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1296 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:29.858957 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:29.859695 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:29.880322 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.880827 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.881312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.882671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.883268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.883708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.150305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:30.154112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:30.168400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.169388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.170878 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.171959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.172767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.174581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.361572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:30.394968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:30.400926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:30.405585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c639a461-caf4-4929-9928-61d0774d45db tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.551427 Sep 07 13:35:30.414046 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 172/349] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:29 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:30.438881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:30.439537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:30.459747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.461270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.464546 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.465612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.466349 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.468309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.564171 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.565045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.565500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.565997 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid 74c03f54-ee87-44e6-827c-f8206c9e8792 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:35:30.693842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:30.740645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7614cf2f-4f00-42e6-a942-62cbb7734a12 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1303 microversion: 2.1 time: 0.315937 Sep 07 13:35:30.761789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 173/350] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:30 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1303 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:30.769011 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:30.772421 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:30.795291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.796734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.797530 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.798844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.799968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.808607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:30.842097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.892107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a418647c-6d1c-406d-98bf-38aebf3bff58 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.743494 Sep 07 13:35:30.900755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 178/351] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:30 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:30.939154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:30.960909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:30.981962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.982937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.992262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.994389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.995749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.996784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.146008 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=20 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:31.528270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:31.541910 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-76661e85-3696-4b0e-92bf-82bb1e1c3a63 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.638842 Sep 07 13:35:31.543233 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 179/352] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:30 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:31.549663 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:31.550800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:31.560070 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.561045 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.561787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.562780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.563499 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.564765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.886699 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:31.894551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:31.896639 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:31.898576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5fab23ed-7742-4651-b93f-c42cd1c988e0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.353002 Sep 07 13:35:31.912407 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 180/353] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:31 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:31.926190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:31.928048 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:31.936500 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.937436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.938390 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.939600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.940315 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.940975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.037612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:32.037612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.037612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.037612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.038838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid 74c03f54-ee87-44e6-827c-f8206c9e8792 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:35:32.157488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:32.168934 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=100 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:32.207137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-89b5174f-81dc-4156-ba5c-10724d873ff1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 200 len: 1303 microversion: 2.1 time: 0.284898 Sep 07 13:35:32.218766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 181/354] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:31 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:32.232966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:32.233963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:32.236676 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:32.248323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fdb72789-11f1-4f61-9a40-659f87f26336 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 1.495668 Sep 07 13:35:32.250219 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 174/355] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:30 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:32.270561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.275698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.276419 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.277644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.280592 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.284086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.585851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:32.587545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:32.607485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.608640 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.616989 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.620321 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.621810 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.626154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.824365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:32.836957 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6cb79eb0-cc13-4a57-9f18-6935b7b85c67 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1721 microversion: 2.1 time: 0.616556 Sep 07 13:35:32.838260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 182/356] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:32 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1721 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:32.933095 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:32.938577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:32.965937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.970333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.973317 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.977890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.979792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.980619 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:33.520411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:33.565847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:33.569821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:33.581864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8a23e3aa-2c16-4c30-99b4-d9c15ad4fef2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.646161 Sep 07 13:35:33.594020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 183/357] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:32 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:33.627941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:33.628741 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: 74c03f54-ee87-44e6-827c-f8206c9e8792] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:33.676940 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.677735 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.680924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:33.683840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.686388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.686944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:33.757029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] HTTP exception thrown: Instance 74c03f54-ee87-44e6-827c-f8206c9e8792 could not be found. Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Request method failure captured: Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 HTTP/1.1 Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ3xFgfSbrqBLnoV_Z71AjmnmhjL6EplGsy3VEuqqsVa5G6t7iYSQlxoLLykWDLjORcAysdZTjM-mvU0_B_SDy0HcMU1WtOARHNjSFH3pjXkFLRKHFRWD3LS445wwPvG6JEhFRVSl89rB7xX_rT1GV-xdNjYAp5pE9GxZOIogTI3VzU Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: da30824feca04ce79489eaccbb6a7001 Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesActionsTest-1063670960 Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:35:33.769608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da30824feca04ce79489eaccbb6a7001"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/da30824feca04ce79489eaccbb6a7001"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da30824feca04ce79489eaccbb6a7001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_da30824feca04ce79489eaccbb6a7001", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesActionsTest-1063670960 Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: da30824feca04ce79489eaccbb6a7001 Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesActionsTest-1063670960 Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesActionsTest-1063670960-project Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 426ecc795ae243ffa7c7e1746e8fc4aa Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesActionsTest-1063670960-project Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 74c03f54-ee87-44e6-827c-f8206c9e8792 could not be found. Sep 07 13:35:33.774039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '74c03f54-ee87-44e6-827c-f8206c9e8792'} Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c03f54-ee87-44e6-827c-f8206c9e8792 could not be found. Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:35:33.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c03f54-ee87-44e6-827c-f8206c9e8792 could not be found. Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c03f54-ee87-44e6-827c-f8206c9e8792 could not be found. Sep 07 13:35:33.797345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:35:33.799615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Returning 404 to user: Instance 74c03f54-ee87-44e6-827c-f8206c9e8792 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:35:33.799615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e51a2ac0-c454-4067-8d65-77d737c82a77 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792" status: 404 len: 111 microversion: 2.1 time: 0.187254 Sep 07 13:35:33.799615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 184/358] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:33 2022] GET /compute/v2.1/servers/74c03f54-ee87-44e6-827c-f8206c9e8792 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:35:33.799615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:33.802551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:33.805375 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:33.840887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ffcf50d4-04f1-4493-a2b7-308c068bc18a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 1.261682 Sep 07 13:35:33.843282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.848094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 175/359] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:32 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:33.850403 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.851459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:33.852781 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.853633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.854667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:33.886876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:33.890786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:33.918518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.920034 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.926217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:33.928090 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.930924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.931985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:34.001449 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:34.233251 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:34.244885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-52b2f107-45c5-4e77-b147-2cda4e72d07a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.462838 Sep 07 13:35:34.244885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 185/360] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:33 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:34.251214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-596592459", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "networks": [{"uuid": "1e1ead8d-5077-46db-809a-4b11b304ff3e"}]}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:34.399084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:34.431823 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0e5a6d63-46fb-4f58-aae0-f114f41ab036 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1698 microversion: 2.1 time: 0.558856 Sep 07 13:35:34.433167 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 176/361] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:33 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1698 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:34.484415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e4708f42-e390-49fb-841a-4a193c6662fd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:34.493192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e4708f42-e390-49fb-841a-4a193c6662fd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:34.493970 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e4708f42-e390-49fb-841a-4a193c6662fd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:34.494619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e4708f42-e390-49fb-841a-4a193c6662fd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:34.617890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e4708f42-e390-49fb-841a-4a193c6662fd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Going to try to start instance {{(pid=151552) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:35:35.102184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e4708f42-e390-49fb-841a-4a193c6662fd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action" status: 202 len: 0 microversion: 2.1 time: 0.622517 Sep 07 13:35:35.109793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 177/362] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:35:34 2022] POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:35:35.129325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:35.137464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:35.171677 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.175173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.176263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.181083 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.191783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.198193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.870348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:35.889623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:35.892043 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:35.893243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f484ec81-f66b-45f3-abc7-0da370d342d7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.779689 Sep 07 13:35:35.907406 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 178/363] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:35 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:35.923310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:35.924209 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:35.933599 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.934423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.935251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.936535 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.937353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.938843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:36.777113 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:36.793588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e903403c-2690-4bfc-95ee-186282e0c36f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.884754 Sep 07 13:35:36.794590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 179/364] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:35 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:36.821785 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:36.823610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:36.846126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:36.851270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:36.852126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:36.853211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:36.853849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:36.854448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.402240 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:37.416213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ecb24f8b-243c-4881-ad4a-0def2545cf41 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1707 microversion: 2.1 time: 0.617295 Sep 07 13:35:37.416809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 180/365] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:36 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1707 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:37.441236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-12fcd1c0-421f-41b6-b4ba-de67847334f6 req-a3824eba-1aba-4e67-99a1-fd5515eeb912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1621bb-92bb-4e45-8381-6c5759220ab7", "tag": "c97fd6b8-038b-4dc0-8912-88161fd117e9"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:37.459135 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-12fcd1c0-421f-41b6-b4ba-de67847334f6 req-a3824eba-1aba-4e67-99a1-fd5515eeb912 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.459957 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-12fcd1c0-421f-41b6-b4ba-de67847334f6 req-a3824eba-1aba-4e67-99a1-fd5515eeb912 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.460547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-12fcd1c0-421f-41b6-b4ba-de67847334f6 req-a3824eba-1aba-4e67-99a1-fd5515eeb912 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.478094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-12fcd1c0-421f-41b6-b4ba-de67847334f6 req-a3824eba-1aba-4e67-99a1-fd5515eeb912 service nova] Creating event network-changed:c97fd6b8-038b-4dc0-8912-88161fd117e9 for instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 on hv-cinder-85625 Sep 07 13:35:37.489263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-12fcd1c0-421f-41b6-b4ba-de67847334f6 req-a3824eba-1aba-4e67-99a1-fd5515eeb912 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051944 Sep 07 13:35:37.493094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 181/366] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:37.504507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:37.505281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:37.520428 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.521288 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.521988 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.523667 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.524503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.525074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.796636 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:37.813569 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-afc9ac78-a377-4c2b-a357-a3d8fa22cc70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.316689 Sep 07 13:35:37.815713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 182/367] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:37 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:37.827680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-3ff7b502-b492-4a04-b355-39139c200071 req-a95ceafd-dba2-4e0a-9152-818d53bf515a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42374ed7-b063-4892-b40a-da27fb0779ce", "name": "network-vif-plugged", "status": "completed", "tag": "024e4e3d-bd89-4219-9aa9-4e5be7865def"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:37.859010 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-3ff7b502-b492-4a04-b355-39139c200071 req-a95ceafd-dba2-4e0a-9152-818d53bf515a service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.860324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-3ff7b502-b492-4a04-b355-39139c200071 req-a95ceafd-dba2-4e0a-9152-818d53bf515a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.861733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-3ff7b502-b492-4a04-b355-39139c200071 req-a95ceafd-dba2-4e0a-9152-818d53bf515a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.888417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-3ff7b502-b492-4a04-b355-39139c200071 req-a95ceafd-dba2-4e0a-9152-818d53bf515a service nova] Creating event network-vif-plugged:024e4e3d-bd89-4219-9aa9-4e5be7865def for instance 42374ed7-b063-4892-b40a-da27fb0779ce on hv-cinder-85625 Sep 07 13:35:37.900415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-3ff7b502-b492-4a04-b355-39139c200071 req-a95ceafd-dba2-4e0a-9152-818d53bf515a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081686 Sep 07 13:35:37.902475 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 183/368] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:37.915106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:37.917571 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:37.931749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.939117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.939117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.939117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.939117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.939671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.159194 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:38.171479 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:38.174594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:38.176085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fe5ee2a2-8d2a-481b-b0e9-787b4be8a0b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.271248 Sep 07 13:35:38.177251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 184/369] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:37 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:38.183408 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:38.186246 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:38.221184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.223097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.224676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.225697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.226297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.226957 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.495548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:38.513735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-659e3915-0953-4c25-b657-df74ef4ba943 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.334939 Sep 07 13:35:38.515148 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 185/370] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:38 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:38.535018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:38.535018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:38.554428 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.555362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.556092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.556836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.557383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.557814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.257046 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:39.286995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ab0b02db-bb23-499a-9221-46a6ae695403 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1707 microversion: 2.1 time: 0.768937 Sep 07 13:35:39.290077 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 186/371] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:38 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1707 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:39.318598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:39.321260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.349518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.350680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.351719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.353059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.354033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.355077 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.846129 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:39.865532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-783cfee4-f725-4590-ab2e-9d671484151d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.574247 Sep 07 13:35:39.879380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 187/372] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:39 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:39.903892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:39.905469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.942313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.014063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.014063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.014063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.014063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.015095 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.214325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:40.229717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:40.232861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:40.235219 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0189ac4a-01f0-4fa5-8ba8-8f0b9075c7b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.338470 Sep 07 13:35:40.236325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 188/373] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:39 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:40.245562 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:40.246261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:40.254070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.255375 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.256235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.257708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.258710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.258710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.463908 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:40.474133 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a8248a2f-37d4-40a8-ae1b-ce6e620e090a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.236290 Sep 07 13:35:40.474853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 189/374] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:40 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:40.481796 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:40.482757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:40.492441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.493326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.493891 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.495233 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.495837 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.496564 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.681353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:40.691814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e67d1c7f-05a2-4b67-a67d-c78362e0655e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1707 microversion: 2.1 time: 0.215062 Sep 07 13:35:40.692661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 190/375] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:40 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1707 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:40.910229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:40.910965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:40.920155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.920663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.921139 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.921862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.922338 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.922791 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:41.120210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:41.131451 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-52b11e93-52a5-436e-a41c-530499a15981 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1371 microversion: 2.1 time: 0.225641 Sep 07 13:35:41.132831 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 191/376] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:40 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:41.187904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] validate_networks() for [('1e1ead8d-5077-46db-809a-4b11b304ff3e', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:35:41.279546 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:41.281176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:41.292640 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:41.293481 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:41.294284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:41.295584 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:41.296797 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:41.297597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:41.917823 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:41.956314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:41.968175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:41.970844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0fc0144c-9c28-4195-95b3-0a31e0462a71 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.704938 Sep 07 13:35:41.974155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 192/377] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:41 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:41.996752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:41.998327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:42.023282 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.025026 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.025839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.027698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.028846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.029559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.082132 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:42.402304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:42.419557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5dccf29b-d7c4-4b31-8e5b-3f58ba83250a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.442799 Sep 07 13:35:42.420494 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 193/378] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:41 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:42.435341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:42.435976 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:42.443067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.443587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.444055 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.445254 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.445734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.446226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.750913 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:35:42.751833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:35:42.753007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:35:42.753543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:35:42.754399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:35:42.778453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.781799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.782614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.784165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.784927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.785644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.826072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Getting quotas for project da30824feca04ce79489eaccbb6a7001. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:42.833002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Getting quotas for user 426ecc795ae243ffa7c7e1746e8fc4aa and project da30824feca04ce79489eaccbb6a7001. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:42.863881 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:35:42.868537 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:35:42.873894 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:42.888459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-93af4cec-e93e-4fec-9898-80df23486368 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1711 microversion: 2.1 time: 0.466847 Sep 07 13:35:42.895393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 194/379] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:42 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1711 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:42.901691 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:42.902851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:42.915601 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.916516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.917491 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.919502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.920579 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.924623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.141055 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.157193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-00e24d5a-1c7d-4f62-9015-33ae6ef446df tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1566 microversion: 2.1 time: 0.265430 Sep 07 13:35:43.158254 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 195/380] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:42 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:43.167731 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:43.168886 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:43.181243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.182115 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.183082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.184389 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.187598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.189646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.234455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-77262637-a3d6-43d6-a031-8c05204bab59 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.988061 Sep 07 13:35:43.235693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 186/381] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:35:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 8990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:35:43.258626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:43.259607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:43.283016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.290172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.290172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.290172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.290172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.291527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.462164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5964a084-875c-4d66-8e43-310cdfa38fef tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224492 Sep 07 13:35:43.463819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 187/382] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:35:43 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-interface => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:43.471644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b035feac-fbdb-482b-8d79-88fdff0a6715 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:43.472482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b035feac-fbdb-482b-8d79-88fdff0a6715 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:43.473985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.493988 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.496055 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.497680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-247f54d0-2a03-47a7-857e-867c8d6657d2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1741 microversion: 2.20 time: 0.337632 Sep 07 13:35:43.498588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 196/383] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:43 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1741 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:43.537715 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:43.541558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:43.566603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.570016 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.570645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.571469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.572028 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.572466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.721183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b035feac-fbdb-482b-8d79-88fdff0a6715 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.741514 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b035feac-fbdb-482b-8d79-88fdff0a6715 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1213 microversion: 2.1 time: 0.274097 Sep 07 13:35:43.742756 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 188/384] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:43 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:43.827553 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.837123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3f0fb187-62c4-4532-b447-97e8f949fb7e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.318851 Sep 07 13:35:43.837691 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 197/385] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:43 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:44.510770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-ebd9efb1-1306-427e-b3f9-d47dccff37fa req-3b222054-53c8-4f5f-a965-4a6a1461f803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1621bb-92bb-4e45-8381-6c5759220ab7", "name": "network-vif-plugged", "status": "completed", "tag": "c97fd6b8-038b-4dc0-8912-88161fd117e9"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:44.527011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-ebd9efb1-1306-427e-b3f9-d47dccff37fa req-3b222054-53c8-4f5f-a965-4a6a1461f803 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.527517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-ebd9efb1-1306-427e-b3f9-d47dccff37fa req-3b222054-53c8-4f5f-a965-4a6a1461f803 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.528350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-ebd9efb1-1306-427e-b3f9-d47dccff37fa req-3b222054-53c8-4f5f-a965-4a6a1461f803 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.543721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:44.549846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:44.550113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-ebd9efb1-1306-427e-b3f9-d47dccff37fa req-3b222054-53c8-4f5f-a965-4a6a1461f803 service nova] Creating event network-vif-plugged:c97fd6b8-038b-4dc0-8912-88161fd117e9 for instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 on hv-cinder-85625 Sep 07 13:35:44.553555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.554871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.556005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-ebd9efb1-1306-427e-b3f9-d47dccff37fa req-3b222054-53c8-4f5f-a965-4a6a1461f803 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052841 Sep 07 13:35:44.556623 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 189/386] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:35:44.567342 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.568499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.569045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.570016 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.791637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:44.795295 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:44.824330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.826141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.826966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.828374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.830390 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.831602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.896031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:44.922854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:44.927324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:44.931769 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bffb2216-8532-4f9b-936b-de945fc3ea91 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1723 microversion: 2.20 time: 0.394375 Sep 07 13:35:44.933576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 198/387] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:44 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:44.943215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:44.944529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:44.961302 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.963921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.964680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.969591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.973695 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.975926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:45.058020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:45.073183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-63d38da4-0721-4ba7-b45b-4947020e8c8c tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1217 microversion: 2.1 time: 0.288362 Sep 07 13:35:45.075066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 190/388] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:44 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1217 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:45.295233 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:45.312620 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fc970aaf-e6be-44bf-9df0-ee32dce6b480 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.375106 Sep 07 13:35:45.323479 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 199/389] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:44 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:45.734080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-df78a52c-7433-4e67-a31c-de99942babed req-69fee9c3-e2c6-48fe-bd4e-415b4350ae73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42374ed7-b063-4892-b40a-da27fb0779ce", "tag": "024e4e3d-bd89-4219-9aa9-4e5be7865def"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:45.749746 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-df78a52c-7433-4e67-a31c-de99942babed req-69fee9c3-e2c6-48fe-bd4e-415b4350ae73 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:45.750526 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-df78a52c-7433-4e67-a31c-de99942babed req-69fee9c3-e2c6-48fe-bd4e-415b4350ae73 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:45.751527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-df78a52c-7433-4e67-a31c-de99942babed req-69fee9c3-e2c6-48fe-bd4e-415b4350ae73 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:45.770090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-df78a52c-7433-4e67-a31c-de99942babed req-69fee9c3-e2c6-48fe-bd4e-415b4350ae73 service nova] Creating event network-changed:024e4e3d-bd89-4219-9aa9-4e5be7865def for instance 42374ed7-b063-4892-b40a-da27fb0779ce on hv-cinder-85625 Sep 07 13:35:45.778943 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-df78a52c-7433-4e67-a31c-de99942babed req-69fee9c3-e2c6-48fe-bd4e-415b4350ae73 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049787 Sep 07 13:35:45.780061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 191/390] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:45.976916 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:45.978781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:45.991922 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:45.994391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:45.995256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:45.996612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:45.997471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:45.998216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.119937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:46.121743 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:46.135591 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.137208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.138790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.140236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.141366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.142579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.317479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:46.351314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fc4bd351-924e-4f1d-98c4-3dfe0ce94428 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1265 microversion: 2.1 time: 0.243146 Sep 07 13:35:46.369962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 192/391] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:46 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:46.392923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:46.402757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:46.431706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.432835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.434427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.436479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.437755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.439088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.470686 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:46.509434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:46.512614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:46.515245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c9198932-cb21-4154-b0f6-c027eaf846ee tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1723 microversion: 2.20 time: 0.551824 Sep 07 13:35:46.516533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 200/392] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:45 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1723 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:46.730022 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:46.772470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-73fbc84a-68d3-46f9-8a9d-1860826404fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.396292 Sep 07 13:35:46.784885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 193/393] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:46 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:47.278742 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1569c23-df0f-4767-b0a0-67cbd877d1b2", "device": "/dev/sdb"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:47.285520 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:47.297572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.298225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.298892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.299810 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.300398 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.301023 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.436757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:47.439958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:47.453616 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.454814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.455779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.457355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.458198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.458966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.570530 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:47.587520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b281c6cd-db86-4b22-92b2-4ee1b8ff9bfd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1265 microversion: 2.1 time: 0.158638 Sep 07 13:35:47.588618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 194/394] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:47 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:47.605787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:47.605787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:47.613640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.614388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.615142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.616891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.617965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.618605 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.901653 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:47.912488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:47.916754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:47.921911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3eb596ef-1945-4d61-a8d1-1dd9e2baa0a2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1723 microversion: 2.20 time: 0.325700 Sep 07 13:35:47.921911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 195/395] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:47 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:47.930290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:47.931466 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:47.952855 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.954253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.955170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.956567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.957376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.958141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.238533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:48.253633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0d641f06-de11-49dc-ac7c-cab2dc810bac tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1363 microversion: 2.1 time: 0.331409 Sep 07 13:35:48.254722 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 196/396] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:47 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:48.264284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-a9f2f872-345c-4d98-8b2f-9a3ff97e3513 req-809a60dd-595c-4af7-a136-2d53004f8be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d77c88-2507-41f1-a8bf-604880929568", "name": "network-vif-unplugged", "status": "completed", "tag": "dbb94b1d-c06e-4515-a9ea-b00bd9245f9d"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:48.282687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a9f2f872-345c-4d98-8b2f-9a3ff97e3513 req-809a60dd-595c-4af7-a136-2d53004f8be7 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.283488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a9f2f872-345c-4d98-8b2f-9a3ff97e3513 req-809a60dd-595c-4af7-a136-2d53004f8be7 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.284237 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a9f2f872-345c-4d98-8b2f-9a3ff97e3513 req-809a60dd-595c-4af7-a136-2d53004f8be7 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.316458 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-a9f2f872-345c-4d98-8b2f-9a3ff97e3513 req-809a60dd-595c-4af7-a136-2d53004f8be7 service nova] Creating event network-vif-unplugged:dbb94b1d-c06e-4515-a9ea-b00bd9245f9d for instance 78d77c88-2507-41f1-a8bf-604880929568 on hv-cinder-85625 Sep 07 13:35:48.322058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-a9f2f872-345c-4d98-8b2f-9a3ff97e3513 req-809a60dd-595c-4af7-a136-2d53004f8be7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065063 Sep 07 13:35:48.328470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 197/397] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:48.633777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:48.635018 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:48.643522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.644312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.644984 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.646276 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.648897 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.649847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.801924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:48.825845 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cd1475fd-4a9d-431b-8838-c3a78e33c6fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1265 microversion: 2.1 time: 0.200303 Sep 07 13:35:48.826705 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 198/398] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:48 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:48.962577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:48.963551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:48.971239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.971754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.972207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.972973 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.973480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.973919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.206690 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:49.219848 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:49.223021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:49.225324 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cbe39e86-8b1a-40a0-8775-5ad2d869240f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1723 microversion: 2.20 time: 0.266885 Sep 07 13:35:49.226523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 199/399] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:48 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:49.292385 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:49.293229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:49.301838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.305860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.305860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.305860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.305860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.306492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.606199 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:49.620789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-88da983c-1219-4b9c-a4f9-cc6e0435fca5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1553 microversion: 2.1 time: 0.335803 Sep 07 13:35:49.621815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 200/400] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:49 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1553 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:49.648827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:49.649875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:49.657508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.658620 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.659420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.660327 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.660993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.661694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.833646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7d93071f-ff6f-490a-99a6-8f1ea6ac3f32 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189678 Sep 07 13:35:49.835843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 201/401] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:35:49 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:49.883808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:49.885105 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:49.899437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.900746 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.901862 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.903221 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.904325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.905059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.111710 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:50.130567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2a976a94-90dd-4dda-aa3d-cec5e3696203 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1265 microversion: 2.1 time: 0.257528 Sep 07 13:35:50.131802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 202/402] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:49 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:50.279625 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:50.281248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:50.296048 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.297257 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.298282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.299846 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.301268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.302312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.364913 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=100 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:50.436090 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9404671f-c5d0-42ee-b650-bcea6ececb91 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "POST /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.164282 Sep 07 13:35:50.437140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 201/403] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:35:47 2022] POST /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f/os-volume_attachments => generated 194 bytes in 3168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:35:50.636588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:50.646391 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:50.648431 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:50.659053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fb3526b8-7450-4fda-8f12-0e346c7ea855 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1726 microversion: 2.20 time: 0.379968 Sep 07 13:35:50.666912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 203/404] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:50 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1726 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:50.678253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f905a6f-a126-4c22-99b7-f955db53e8b2"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:50.682736 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:50.692832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.693341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.693818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.694789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.696866 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.702039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:51.181667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:51.181667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:51.183258 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:51.184018 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:51.185078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:51.186334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:51.187102 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:51.187692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:51.323317 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:51.341646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a045fe0d-85dd-4e51-a844-33fbf7c9fde3 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1273 microversion: 2.1 time: 0.172999 Sep 07 13:35:51.342446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 204/405] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:51 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:51.848788 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-4ef97b84-0abd-4500-a534-dc3031579863 req-8981c4de-2c15-41c2-9c79-fa5ebc4daba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1621bb-92bb-4e45-8381-6c5759220ab7", "tag": "c97fd6b8-038b-4dc0-8912-88161fd117e9"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:51.872019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4ef97b84-0abd-4500-a534-dc3031579863 req-8981c4de-2c15-41c2-9c79-fa5ebc4daba5 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:51.873581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4ef97b84-0abd-4500-a534-dc3031579863 req-8981c4de-2c15-41c2-9c79-fa5ebc4daba5 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:51.874806 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4ef97b84-0abd-4500-a534-dc3031579863 req-8981c4de-2c15-41c2-9c79-fa5ebc4daba5 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:51.909282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-4ef97b84-0abd-4500-a534-dc3031579863 req-8981c4de-2c15-41c2-9c79-fa5ebc4daba5 service nova] Creating event network-changed:c97fd6b8-038b-4dc0-8912-88161fd117e9 for instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 on hv-cinder-85625 Sep 07 13:35:51.920007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-4ef97b84-0abd-4500-a534-dc3031579863 req-8981c4de-2c15-41c2-9c79-fa5ebc4daba5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077897 Sep 07 13:35:51.921460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 205/406] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:35:52.378405 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:52.379960 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:52.393410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:52.394298 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:52.394796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:52.395587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:52.396060 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:52.396548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:52.573271 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c6a6d405-6db4-4859-88d7-14893ae36a46 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.899801 Sep 07 13:35:52.582614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 202/407] 10.222.0.62 () {62 vars in 1364 bytes} [Wed Sep 7 13:35:50 2022] POST /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments => generated 188 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:35:52.797352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:52.799303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:52.801495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:52.808816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:52.826273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=86 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:52.826273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:52.826273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:52.826273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:52.827460 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:52.827460 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:52.827717 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7874707d-b7f4-481b-8fb1-bdde654a0ba2 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.453413 Sep 07 13:35:52.827853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:52.827994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 206/408] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:52 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:52.977812 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=151552) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:35:53.426457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-df01e288-0c0d-476e-8ba7-263f17f5adeb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/action" status: 202 len: 0 microversion: 2.20 time: 0.648762 Sep 07 13:35:53.429390 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 203/409] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 7 13:35:52 2022] POST /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:35:53.457460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:53.460516 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:53.477720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:53.479387 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:53.480645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:53.481772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:53.483141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:53.484340 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:53.738560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=8 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:53.877935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:53.879112 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:53.909053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:53.909840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:53.910661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:53.912557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:53.913402 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:53.914164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:54.264360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:54.279819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-40c36bcf-2f5a-4670-b576-df2ce969c890 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.409608 Sep 07 13:35:54.281662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 204/410] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:53 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:54.345932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:54.365856 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:54.369260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:54.373305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c97a23fc-d433-4c94-96e7-59fac0fa2a7a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1752 microversion: 2.20 time: 0.935794 Sep 07 13:35:54.374736 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 207/411] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:53 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1752 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:54.964413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-7a6243d2-765b-4087-9aac-0c29d22b24c4 req-c37561e8-d45c-4b81-9c61-ed7ef93ecb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e099340a-57c8-4d43-a219-c523dc55d475", "tag": "57ac9e4a-043c-4f9b-a21e-a723f6549792"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:54.988520 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-7a6243d2-765b-4087-9aac-0c29d22b24c4 req-c37561e8-d45c-4b81-9c61-ed7ef93ecb99 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:54.990465 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-7a6243d2-765b-4087-9aac-0c29d22b24c4 req-c37561e8-d45c-4b81-9c61-ed7ef93ecb99 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:54.992004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-7a6243d2-765b-4087-9aac-0c29d22b24c4 req-c37561e8-d45c-4b81-9c61-ed7ef93ecb99 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:54.998551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:55.010497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-7a6243d2-765b-4087-9aac-0c29d22b24c4 req-c37561e8-d45c-4b81-9c61-ed7ef93ecb99 service nova] Creating event network-changed:57ac9e4a-043c-4f9b-a21e-a723f6549792 for instance e099340a-57c8-4d43-a219-c523dc55d475 on hv-cinder-85625 Sep 07 13:35:55.025537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-7a6243d2-765b-4087-9aac-0c29d22b24c4 req-c37561e8-d45c-4b81-9c61-ed7ef93ecb99 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069560 Sep 07 13:35:55.027145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 205/412] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:35:55.322072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:55.325809 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:55.341372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:55.342442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:55.343315 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:55.344203 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:55.344939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:55.345846 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:55.429326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:55.436384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:55.456697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:55.457601 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:55.458408 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:55.461875 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:55.462805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:55.464011 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:55.801116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:55.818091 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a51107d4-e43d-4359-8216-9afd7314f92b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.508527 Sep 07 13:35:55.832353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 208/413] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:55 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:55.841927 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:55.876292 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:55.883526 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:55.889733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4792c123-497c-483e-ad7e-12e411e50ec6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1752 microversion: 2.20 time: 0.465881 Sep 07 13:35:55.889733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 206/414] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:55 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1752 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:56.868093 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:56.869298 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:56.882681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:56.884064 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:56.886523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:56.886523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:56.887786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:56.888022 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:56.922735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:56.924326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:56.938022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:56.939943 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:56.941166 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:56.956226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:56.957117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:56.957934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:57.153968 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:57.167225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5691d258-abe8-407d-bacc-6391446602ad tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.307233 Sep 07 13:35:57.168084 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 209/415] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:56 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:57.207470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:57.219759 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:57.222094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:57.223890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e8e2f945-80c9-4908-a552-6ea2d1f1c752 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1754 microversion: 2.20 time: 0.310889 Sep 07 13:35:57.225416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 207/416] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:56 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1754 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:35:58.201655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:58.202277 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:58.210429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:58.211181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:58.214825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:58.214825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:58.214825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:58.214825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:58.257816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:58.259010 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:58.268237 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:58.269039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:58.269614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:58.270630 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:58.271260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:58.273464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:58.448954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:58.465457 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6644002d-09e5-40f3-9d3d-6112bbed8d8b tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.267538 Sep 07 13:35:58.466576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 210/417] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:58 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:58.512619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:58.531311 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:58.534602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:58.538871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-880c95c9-4370-40e3-b013-de3ecf7a7cf4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1754 microversion: 2.20 time: 0.283913 Sep 07 13:35:58.539409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 208/418] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:58 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1754 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:35:59.493030 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:59.493840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:59.501991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:59.502807 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:59.503553 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:59.504386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:59.504983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:59.505535 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:59.595778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:59.605376 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:59.619499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:59.620918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:59.622414 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:59.623825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:59.625291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:59.626005 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:59.795136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:59.821483 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d446939e-6407-4b14-8b83-4cb7c2f246aa tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.333469 Sep 07 13:35:59.827193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 211/419] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:59 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:59.835717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:59.859705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:59.863283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:59.866278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-da14eebc-dae7-42af-9f16-9ed716bbed8e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1754 microversion: 2.20 time: 0.282053 Sep 07 13:35:59.879538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 209/420] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:35:59 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1754 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:00.855701 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:00.856811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:00.869747 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:00.870645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:00.871515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:00.872808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:00.873615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:00.874386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:00.929370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:00.930688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:00.961880 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:00.962780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:00.963358 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:00.964535 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:00.965112 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:00.965651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:01.180533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:01.198572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-189ec6b3-550e-48eb-9add-3996cdfe8bb8 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.350896 Sep 07 13:36:01.199567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 212/421] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:00 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:01.200960 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:01.228808 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:01.231547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:01.235376 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a504b7cf-709e-4072-bccd-b335a9b5f205 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1754 microversion: 2.20 time: 0.325645 Sep 07 13:36:01.237560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 210/422] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:00 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1754 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:02.234283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:02.235579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:02.246214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:02.247105 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:02.247848 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:02.249026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:02.249622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:02.250110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:02.272462 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:02.274840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:02.289617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:02.289617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:02.289617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:02.289617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:02.303236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:02.303236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:02.502186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:02.511819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-568cb07b-ebbc-41d4-9598-951f129006da tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.284643 Sep 07 13:36:02.512681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 213/423] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:02 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:02.543178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:02.559481 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:02.562571 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:02.565139 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2a5c3641-1f34-4a41-b088-59db705c1d04 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1754 microversion: 2.20 time: 0.300552 Sep 07 13:36:02.566340 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 211/424] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:02 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1754 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:03.545209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:03.546401 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:03.558676 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:03.559625 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:03.560448 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:03.561769 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:03.562625 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:03.563457 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:03.604852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:03.605750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:03.612782 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:03.613271 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:03.613733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:03.617570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:03.617570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:03.617570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:03.776302 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:03.785740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-eb862e02-8827-48be-a4ac-e2f8163e5b07 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.251275 Sep 07 13:36:03.803236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 214/425] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:03 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:03.844711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:03.860491 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:03.863753 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:03.867237 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d0ddec66-b7f3-4514-ba2c-659298efbab2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.267392 Sep 07 13:36:03.868329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 212/426] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:03 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:04.817227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:04.817938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:04.821326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:04.826687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:04.827240 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:04.827922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:04.828401 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:04.828863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:04.829297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:04.902488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:04.903850 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:04.919800 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:04.920783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:04.922274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:04.925536 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:04.926913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:04.928647 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:05.046069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:05.061684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d74aa6fd-7a03-4db3-9311-f5d3152f55de tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.248116 Sep 07 13:36:05.063840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 215/427] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:04 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:05.154120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:05.165665 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:05.168096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:05.169687 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3561784c-111c-4a13-97f2-d7b9c20ed6ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.275750 Sep 07 13:36:05.170473 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 213/428] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:04 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:05.551532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-c0d2a89a-efa6-4cf6-a3fe-7513e4391e3a req-3a97f04f-187b-4554-8551-3f68c82446b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e099340a-57c8-4d43-a219-c523dc55d475", "name": "network-vif-plugged", "status": "completed", "tag": "57ac9e4a-043c-4f9b-a21e-a723f6549792"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:05.563061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c0d2a89a-efa6-4cf6-a3fe-7513e4391e3a req-3a97f04f-187b-4554-8551-3f68c82446b7 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:05.563553 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c0d2a89a-efa6-4cf6-a3fe-7513e4391e3a req-3a97f04f-187b-4554-8551-3f68c82446b7 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:05.564455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c0d2a89a-efa6-4cf6-a3fe-7513e4391e3a req-3a97f04f-187b-4554-8551-3f68c82446b7 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:05.579131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-c0d2a89a-efa6-4cf6-a3fe-7513e4391e3a req-3a97f04f-187b-4554-8551-3f68c82446b7 service nova] Creating event network-vif-plugged:57ac9e4a-043c-4f9b-a21e-a723f6549792 for instance e099340a-57c8-4d43-a219-c523dc55d475 on hv-cinder-85625 Sep 07 13:36:05.588718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-c0d2a89a-efa6-4cf6-a3fe-7513e4391e3a req-3a97f04f-187b-4554-8551-3f68c82446b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040718 Sep 07 13:36:05.589736 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 216/429] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:06.096899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:06.097595 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:06.107031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:06.107968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:06.108654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:06.109589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:06.110297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:06.111030 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:06.213829 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:06.214778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:06.229060 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:06.229946 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:06.230750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:06.232052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:06.233198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:06.234243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:06.486283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:06.505643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9d9b44bf-33c8-4721-8f7a-c94565c1225a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.412776 Sep 07 13:36:06.508955 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 214/430] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:06 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:06.644031 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:06.656300 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:06.657798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:06.659258 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fdd95adc-0693-4169-9a70-6a330c00f73d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.452974 Sep 07 13:36:06.659847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 217/431] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:06 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:07.551047 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:07.551793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:07.561201 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:07.562124 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:07.562953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:07.564350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:07.565201 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:07.565985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:07.691932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:07.694527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:07.706880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:07.707767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:07.708441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:07.710129 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:07.712056 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:07.712674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:07.786212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:07.801841 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-03e17c6d-2e62-48a1-960b-df9d0af03e6d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.255039 Sep 07 13:36:07.807825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 215/432] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:07 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:07.937155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:07.953817 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:07.956757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:07.958944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-53735f2b-4ec4-4bd8-aa3a-fb00918adf50 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.271775 Sep 07 13:36:07.959799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 218/433] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:07 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:08.841160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:08.842131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:08.852459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:08.853038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:08.853569 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:08.854375 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:08.855120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:08.855589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:09.003319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:09.004362 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:09.013162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:09.013868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:09.014484 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:09.015564 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:09.016128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:09.016648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:09.109301 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:09.131206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-46102a12-535d-453c-ad5c-6948ffb58e0e tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.291989 Sep 07 13:36:09.132057 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 216/434] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:08 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:09.250296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:09.268503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:09.272312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:09.274363 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c06abbd4-dade-4306-86d3-8f284a1bb641 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.275952 Sep 07 13:36:09.275313 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 219/435] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:08 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:10.162528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:10.163414 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:10.171723 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:10.172293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:10.172845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:10.173870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:10.174408 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:10.174902 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:10.306798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:10.307915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:10.316917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:10.317503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:10.318011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:10.319299 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:10.320014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:10.320579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:10.372208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:10.388073 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-01ba36ae-912e-4894-b21a-01ab3c8b06f1 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1313 microversion: 2.1 time: 0.229851 Sep 07 13:36:10.395231 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 217/436] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:10 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:10.639747 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:10.660364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:10.661959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:10.664370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d60ba7a5-bb2e-4052-81c2-e07e9ccc1431 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.362064 Sep 07 13:36:10.664370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 220/437] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:10 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:11.438040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:11.439518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:11.451935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:11.452819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:11.453617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:11.455248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:11.456149 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:11.456912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:11.706354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:11.706354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:11.713743 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:11.715088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:11.716164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:11.717809 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:11.718951 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:11.720029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:11.727598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:11.744681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-21218846-05cb-4a29-bc40-1a8a3451cb0a tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1497 microversion: 2.1 time: 0.314335 Sep 07 13:36:11.746326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 218/438] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:11 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1497 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:11.759385 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=100 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:11.965937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:11.978848 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:11.980524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:11.981989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-321881d5-1cd2-480f-8ed0-b217a004782c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.294121 Sep 07 13:36:11.982764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 221/439] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:11 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:13.037045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:13.040011 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:13.054207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:13.055755 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:13.057140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:13.058930 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:13.064576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:13.068970 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:13.388345 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:13.408165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:13.412489 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:13.415919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-64d3b452-29bb-4da8-bea7-bdd9d3b10105 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.386921 Sep 07 13:36:13.417010 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 219/440] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:13 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:14.452144 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:14.452871 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:14.463316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:14.464185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:14.464682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:14.465424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:14.465892 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:14.466418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:14.738647 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:14.759912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:14.762742 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:14.765528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-dc5a25a0-9b0e-488a-b894-b6e47d906dcf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.317063 Sep 07 13:36:14.766659 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 222/441] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:14 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:15.482269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:15.484518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:15.495899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:15.496735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:15.497158 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:15.498182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:15.499152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:15.499940 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:15.549556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Going to try to terminate instance {{(pid=151552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:36:15.750448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:15.824218 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:15.825124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:15.837256 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:15.838775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:15.839963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:15.841306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:15.843369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:15.844653 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:16.144739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:16.157366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:16.159531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:16.161754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-816b23bf-66c1-46b0-9458-e6981636cc39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.346019 Sep 07 13:36:16.162722 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 223/442] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:15 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:16.476671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-75a9ab00-91e7-4535-b8fa-810694827069 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 204 len: 0 microversion: 2.1 time: 1.001755 Sep 07 13:36:16.477744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 220/443] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:36:15 2022] DELETE /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:36:16.497702 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:16.497702 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:16.504970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:16.505827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:16.507140 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:16.508345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:16.509121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:16.509827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:16.780070 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:16.790833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-966ffccc-31a5-49da-934b-58d695c78c48 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.304917 Sep 07 13:36:16.791780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 224/444] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:16 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:17.213905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:17.214901 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:17.226296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:17.227387 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:17.230968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:17.230968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:17.230968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:17.230968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:17.519140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:17.519140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:17.520010 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:17.520572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-047de073-d389-43ab-b73a-c658df87ac42 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.313615 Sep 07 13:36:17.522097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 221/445] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:17 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:17.828770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:17.834420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:17.849834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:17.850966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:17.852050 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:17.853057 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:17.853711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:17.854479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:18.123918 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:18.134476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-80aea6a2-360c-4f1b-b481-fff51c6ccd3d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.312913 Sep 07 13:36:18.141739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 225/446] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:17 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:18.557439 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:18.562291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:18.576873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:18.580578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:18.580578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:18.580578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:18.581636 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:18.582804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:18.862794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:18.877845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:18.879589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:18.881229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d76f04aa-91e5-449e-82cf-e542cc2a7ee5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.332719 Sep 07 13:36:18.881861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 222/447] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:18 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:19.173426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:19.179932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:19.207587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:19.208362 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:19.211539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:19.220281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:19.221470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:19.222214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:19.549015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:19.572334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e81040ea-7ac5-42ee-9f18-8d34ee8b92c0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.405738 Sep 07 13:36:19.581580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 226/448] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:19 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:19.921265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:19.923065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:19.936372 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:19.939608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:19.939608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:19.939608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:19.939608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:19.940175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:20.170231 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:20.190275 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:20.193948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:20.196312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6417ac59-8e8b-41cf-a951-7f60d18282d0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.281816 Sep 07 13:36:20.197840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 223/449] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:19 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:20.637343 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:20.644792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:20.654256 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:20.654886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:20.655609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:20.656478 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:20.657205 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:20.657945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:20.902302 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:20.911909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7276e6f9-b322-4fe1-88ef-392eeb7a5916 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.283455 Sep 07 13:36:20.913409 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 227/450] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:20 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:21.243490 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:21.244641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:21.257947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.259053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.259866 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.261181 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.262069 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.262867 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.523697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:21.540662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:21.543219 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:21.544712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-57aeddf0-e8a4-483d-8e3c-e905ca7b396f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.308974 Sep 07 13:36:21.545464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 224/451] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:21 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:21.815850 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:21.818455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:21.834191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.835547 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.836983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.838728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.839932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.841182 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.961510 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:21.962297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:21.970469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.971294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.971843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.972698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.973290 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.973856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:22.063944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'services' on Instance uuid 57347a10-9415-44b7-a4e0-d588355cc98f {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:22.430561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-140fd0a9-5508-497b-b768-d0190c2c799e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "DELETE /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f/os-volume_attachments/e1569c23-df0f-4767-b0a0-67cbd877d1b2" status: 202 len: 0 microversion: 2.1 time: 0.623224 Sep 07 13:36:22.431326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 228/452] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:36:21 2022] DELETE /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f/os-volume_attachments/e1569c23-df0f-4767-b0a0-67cbd877d1b2 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:36:22.581463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:22.582373 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:22.596214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:22.597107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:22.597906 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:22.599329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:22.600208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:22.600947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:22.716562 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:22.732071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-617abab3-9b7f-4d9c-b13f-b067b2b92899 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.776515 Sep 07 13:36:22.733882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 225/453] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:21 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:22.899080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:22.915040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:22.918505 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:22.920739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b837eb23-2274-4e41-a83d-60ff108b5a37 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.345720 Sep 07 13:36:22.921941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 229/454] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:22 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:23.779807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:23.782215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:23.804212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:23.807135 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:23.808398 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:23.809600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:23.810882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:23.812326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:23.813501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:23.975041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:23.977309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:23.994005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:23.996780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:23.997248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:24.000372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:24.001465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:24.002393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:24.160153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:24.199200 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ade8d254-2c7b-496e-873d-011a6662c001 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.424849 Sep 07 13:36:24.219027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 226/455] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:23 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:24.369801 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:24.394767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:24.398106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:24.400629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0d440509-325e-4e59-876f-b46f3a49e815 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.434233 Sep 07 13:36:24.402661 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 230/456] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:23 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:25.260347 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:25.261365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:25.273995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:25.274901 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:25.275753 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:25.277077 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:25.278092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:25.278872 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:25.448626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:25.451757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:25.480544 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:25.481463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:25.482269 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:25.483677 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:25.484765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:25.486101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:25.537042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:25.548721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-60b46b21-8268-467a-8250-e2d0ec19c79d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.297527 Sep 07 13:36:25.549818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 227/457] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:25 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:25.752094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:25.772185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:25.775606 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:25.777978 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-80acc8db-2bfe-4e95-b966-1e99274621c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.336725 Sep 07 13:36:25.779010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 231/458] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:25 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:26.579371 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:26.580448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:26.592839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:26.593730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:26.594538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:26.595951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:26.596832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:26.597650 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:26.805513 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:26.821962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e6437a87-853d-48d4-8566-3bf466bb20fd tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.250300 Sep 07 13:36:26.823297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 228/459] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:26 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:26.833201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:26.834738 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:26.847846 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:26.848970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:26.850042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:26.851436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:26.852465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:26.853277 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:27.085433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:27.100837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:27.104250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:27.105850 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cf18195e-aa24-4cf0-b3dc-61d83aecaa33 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.281106 Sep 07 13:36:27.115991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 232/460] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:26 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:27.865625 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:27.866376 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:27.877155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:27.879499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:27.879499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:27.880318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:27.881433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:27.882229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:28.105537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:28.122447 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-279a2b44-2021-46e2-a4da-dfe28e94c4b7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.263627 Sep 07 13:36:28.139514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 229/461] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:27 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:28.159843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:28.170779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:28.186636 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:28.187207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:28.188003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:28.189774 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:28.190918 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:28.191697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:28.433089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:28.450049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:28.453003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:28.455104 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8c14805f-ee38-44ff-ab0f-e83d5b50cbd4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.308648 Sep 07 13:36:28.456046 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 233/462] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:28 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:29.173917 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:29.176216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:29.201217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.202800 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.205545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.207858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.210165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.211316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.507871 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:29.508770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:29.524186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.525347 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.532317 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.537227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.538191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.539049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.652818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:29.682276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-457c9ae2-2bbf-4335-8bd0-81cdf2521da0 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1503 microversion: 2.1 time: 0.521235 Sep 07 13:36:29.686029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 230/463] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:29 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1503 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:29.914733 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:29.937441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:29.941979 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:29.946647 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b9e37927-1180-49c8-bb0e-2d14e5645c88 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.451601 Sep 07 13:36:29.948794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 234/464] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:29 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:30.278266 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-30404b1f-6e73-48c8-8633-42454e7c0fa9 req-1a2aaf2a-6179-427b-b33c-b8ef81e61ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e099340a-57c8-4d43-a219-c523dc55d475", "name": "network-vif-deleted", "tag": "57ac9e4a-043c-4f9b-a21e-a723f6549792"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:30.297870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-30404b1f-6e73-48c8-8633-42454e7c0fa9 req-1a2aaf2a-6179-427b-b33c-b8ef81e61ff6 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.301446 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-30404b1f-6e73-48c8-8633-42454e7c0fa9 req-1a2aaf2a-6179-427b-b33c-b8ef81e61ff6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.301446 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-30404b1f-6e73-48c8-8633-42454e7c0fa9 req-1a2aaf2a-6179-427b-b33c-b8ef81e61ff6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.319426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-30404b1f-6e73-48c8-8633-42454e7c0fa9 req-1a2aaf2a-6179-427b-b33c-b8ef81e61ff6 service nova] Creating event network-vif-deleted:57ac9e4a-043c-4f9b-a21e-a723f6549792 for instance e099340a-57c8-4d43-a219-c523dc55d475 on hv-cinder-85625 Sep 07 13:36:30.326330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-30404b1f-6e73-48c8-8633-42454e7c0fa9 req-1a2aaf2a-6179-427b-b33c-b8ef81e61ff6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055305 Sep 07 13:36:30.327409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 231/465] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:30.549116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:30.549992 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:30.562175 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.563438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.564456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.566175 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.567061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.568216 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.628674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:36:30.742506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:30.743865 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:30.756397 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.757307 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.762602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.762602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.762602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.762602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.834946 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.835851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.836666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.837543 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid e099340a-57c8-4d43-a219-c523dc55d475 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:30.854864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:30.922954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:30.938663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-340b989d-08fc-438e-ad95-1d96b324f3ed tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1303 microversion: 2.1 time: 0.204527 Sep 07 13:36:30.939786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 232/466] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:30 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:30.991144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:30.992272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:31.001276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.002117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:31.002860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:31.004175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.006140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:31.007133 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:31.120816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5f17f24c-5ab4-4846-b1dd-ac26ec264515 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "DELETE /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 204 len: 0 microversion: 2.1 time: 0.578656 Sep 07 13:36:31.121707 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 235/467] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:36:30 2022] DELETE /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:36:31.135487 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:31.136708 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:31.147643 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.148444 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:31.149150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:31.150109 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.150735 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:31.151580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:31.273359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:31.285773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:31.288570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:31.290144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-31b90e13-dae4-4d84-a4f9-fe92721275c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.307356 Sep 07 13:36:31.290849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 233/468] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:30 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:31.416990 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:31.431705 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-863d94d4-d9a3-4365-9b10-42d8b3e06464 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1511 microversion: 2.1 time: 0.302870 Sep 07 13:36:31.432744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 236/469] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:31 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:31.981470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:31.982658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:31.995900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.996713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:31.997516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:31.998945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.999862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.001895 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:32.053389 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:32.054232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.054743 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:32.055474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid e099340a-57c8-4d43-a219-c523dc55d475 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:32.116306 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:32.133110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ce27ba4f-23da-446f-a44a-f997f0fa5cc7 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1303 microversion: 2.1 time: 0.160233 Sep 07 13:36:32.134259 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 234/470] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:31 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:32.326838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:32.328235 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:32.345873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:32.347488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.349356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:32.352047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:32.353556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.354344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:32.562215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:32.563394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:32.574805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:32.575887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.576734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:32.578182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:32.579213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.580275 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:32.619113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:32.638625 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:32.641339 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:32.645038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6c7d2739-57c8-4557-8a05-00c09f8daadd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.324829 Sep 07 13:36:32.645038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 237/471] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:32 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:32.807609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:32.818470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0aea4e98-d878-4c49-86c8-1e1679cf99a2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1511 microversion: 2.1 time: 0.262007 Sep 07 13:36:32.819275 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 235/472] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:32 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:33.173523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:33.174775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:33.186281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:33.187148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:33.187869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.189086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:33.189917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:33.190617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.253008 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:33.253810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:33.254592 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.256600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid e099340a-57c8-4d43-a219-c523dc55d475 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:33.330954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:33.347734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-373a41cc-7f4f-4085-8e65-0cea49286435 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1303 microversion: 2.1 time: 0.180981 Sep 07 13:36:33.349162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 238/473] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:33 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:33.701103 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:33.706223 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:33.718925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:33.720112 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:33.720909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.721863 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:33.722486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:33.723035 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.849167 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:33.850074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:33.859583 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:33.860261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:33.860785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.861658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:33.862137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:33.862861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.943918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:33.960613 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:33.963781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:33.965721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b977871e-a764-40e2-bbf4-fed5c0c23186 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.278545 Sep 07 13:36:33.966412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 236/474] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:33 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:34.104019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:34.118881 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-10400dd2-b458-48f2-8b7d-c2993963bec4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1511 microversion: 2.1 time: 0.276567 Sep 07 13:36:34.120098 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 239/475] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:33 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:34.388004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:34.389129 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:34.400139 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:34.400960 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:34.401747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:34.402964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:34.403714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:34.404445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:34.433629 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:34.466823 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:34.467737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:34.468456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:34.469204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid e099340a-57c8-4d43-a219-c523dc55d475 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:34.545156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:34.561654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a073fe25-3b40-4fc6-8983-598c4404fe87 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1303 microversion: 2.1 time: 0.180461 Sep 07 13:36:34.562698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 237/476] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:34 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:35.020434 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:35.021552 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:35.026264 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:35.036753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.037805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.038616 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.040034 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.043613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.043613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.169861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:35.176415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:35.189595 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.191242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.192052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.194022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.194857 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.195659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.437928 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:35.455007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:35.463345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:35.465740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0bc1c849-149c-49a5-9675-554204f81f2b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.450376 Sep 07 13:36:35.481843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 240/477] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:35 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:35.561033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:35.578062 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e7a938b0-9f36-4c8c-99d6-93df1e8a8f2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1511 microversion: 2.1 time: 0.424031 Sep 07 13:36:35.580028 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 238/478] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:35 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:35.611898 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:35.613354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:35.642070 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.643262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.647076 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.648754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.649720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.650438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.732510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.733664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.734448 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.735122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lazy-loading 'fault' on Instance uuid e099340a-57c8-4d43-a219-c523dc55d475 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:35.797690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-b466cfb2-ca8e-4473-99ac-8489d837d317 req-2954e9db-4e9d-4710-90d7-0bea0febf20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57347a10-9415-44b7-a4e0-d588355cc98f", "name": "network-vif-deleted", "tag": "20121b11-8f66-48fb-a5f4-2672fc1e6d0c"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:35.826049 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-b466cfb2-ca8e-4473-99ac-8489d837d317 req-2954e9db-4e9d-4710-90d7-0bea0febf20a service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.828042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-b466cfb2-ca8e-4473-99ac-8489d837d317 req-2954e9db-4e9d-4710-90d7-0bea0febf20a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.828859 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-b466cfb2-ca8e-4473-99ac-8489d837d317 req-2954e9db-4e9d-4710-90d7-0bea0febf20a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.836477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426ecc795ae243ffa7c7e1746e8fc4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da30824feca04ce79489eaccbb6a7001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:35.853881 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-615517bc-2dec-4313-84b5-35c3a98adb18 tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 200 len: 1303 microversion: 2.1 time: 0.249448 Sep 07 13:36:35.854795 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-b466cfb2-ca8e-4473-99ac-8489d837d317 req-2954e9db-4e9d-4710-90d7-0bea0febf20a service nova] Creating event network-vif-deleted:20121b11-8f66-48fb-a5f4-2672fc1e6d0c for instance 57347a10-9415-44b7-a4e0-d588355cc98f on hv-cinder-85625 Sep 07 13:36:35.855599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 241/479] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:35 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:35.871089 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-b466cfb2-ca8e-4473-99ac-8489d837d317 req-2954e9db-4e9d-4710-90d7-0bea0febf20a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081178 Sep 07 13:36:35.872789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 239/480] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:36:36.515920 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:36.516749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:36.535678 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.538324 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.539047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.540138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.540819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.541619 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.626525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:36.633773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:36.640751 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.642316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.643606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.645483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.647706 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.647950 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.723368 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.725050 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.726021 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.726820 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'fault' on Instance uuid 57347a10-9415-44b7-a4e0-d588355cc98f {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:36.813469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:36.825915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:36.830454 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b28a98a0-9951-421e-8510-3c57b269b9f7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1306 microversion: 2.1 time: 0.212633 Sep 07 13:36:36.843607 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 240/481] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:36 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1306 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:36.852619 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:36.856333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:36.859319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9498c970-5563-4540-9d36-bf747e61a69e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.347985 Sep 07 13:36:36.866192 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 242/482] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:36 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:36.898085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:36.899334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] [instance: e099340a-57c8-4d43-a219-c523dc55d475] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:36.909642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.910156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.910870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.912610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.913419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.914182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.939974 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] HTTP exception thrown: Instance e099340a-57c8-4d43-a219-c523dc55d475 could not be found. Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Request method failure captured: Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 HTTP/1.1 Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ3xFgfSbrqBLnoV_Z71AjmnmhjL6EplGsy3VEuqqsVa5G6t7iYSQlxoLLykWDLjORcAysdZTjM-mvU0_B_SDy0HcMU1WtOARHNjSFH3pjXkFLRKHFRWD3LS445wwPvG6JEhFRVSl89rB7xX_rT1GV-xdNjYAp5pE9GxZOIogTI3VzU Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: da30824feca04ce79489eaccbb6a7001 Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-VolumesActionsTest-1063670960 Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:36:36.941998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da30824feca04ce79489eaccbb6a7001"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/da30824feca04ce79489eaccbb6a7001"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da30824feca04ce79489eaccbb6a7001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_da30824feca04ce79489eaccbb6a7001", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-VolumesActionsTest-1063670960 Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: da30824feca04ce79489eaccbb6a7001 Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-VolumesActionsTest-1063670960 Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-VolumesActionsTest-1063670960-project Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 426ecc795ae243ffa7c7e1746e8fc4aa Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-VolumesActionsTest-1063670960-project Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance e099340a-57c8-4d43-a219-c523dc55d475 could not be found. Sep 07 13:36:36.945058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': 'e099340a-57c8-4d43-a219-c523dc55d475'} Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e099340a-57c8-4d43-a219-c523dc55d475 could not be found. Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:36:36.946770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e099340a-57c8-4d43-a219-c523dc55d475 could not be found. Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e099340a-57c8-4d43-a219-c523dc55d475 could not be found. Sep 07 13:36:36.949828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:36.952364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] Returning 404 to user: Instance e099340a-57c8-4d43-a219-c523dc55d475 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:36:36.952364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e705cf88-a144-4bcb-b55b-956d7d42572d tempest-VolumesActionsTest-1063670960 tempest-VolumesActionsTest-1063670960-project] 10.222.0.62 "GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475" status: 404 len: 111 microversion: 2.1 time: 0.053128 Sep 07 13:36:36.952364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 241/483] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:36 2022] GET /compute/v2.1/servers/e099340a-57c8-4d43-a219-c523dc55d475 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:36:37.874366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:37.875262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:37.885403 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:37.886200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:37.886656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:37.888200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:37.889717 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:37.890486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:37.908715 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:37.911480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:37.952875 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:37.957301 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:37.958617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:37.959974 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:37.960791 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:37.961547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:37.963597 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:37.964692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:37.965792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:37.967400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'fault' on Instance uuid 57347a10-9415-44b7-a4e0-d588355cc98f {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:38.082446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:38.103073 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e35b47ff-6c7c-484c-a12d-0655ba05abe2 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 200 len: 1306 microversion: 2.1 time: 0.235209 Sep 07 13:36:38.104987 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 243/484] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:37 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:38.231340 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-b40f3704-062a-4daf-9173-6c33d5e64893 req-e85e337a-f307-4e2d-bb33-d1beb61a8d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d77c88-2507-41f1-a8bf-604880929568", "name": "network-vif-plugged", "status": "completed", "tag": "dbb94b1d-c06e-4515-a9ea-b00bd9245f9d"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:38.255442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-b40f3704-062a-4daf-9173-6c33d5e64893 req-e85e337a-f307-4e2d-bb33-d1beb61a8d9c service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:38.255442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-b40f3704-062a-4daf-9173-6c33d5e64893 req-e85e337a-f307-4e2d-bb33-d1beb61a8d9c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:38.255442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-b40f3704-062a-4daf-9173-6c33d5e64893 req-e85e337a-f307-4e2d-bb33-d1beb61a8d9c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:38.293649 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-b40f3704-062a-4daf-9173-6c33d5e64893 req-e85e337a-f307-4e2d-bb33-d1beb61a8d9c service nova] Creating event network-vif-plugged:dbb94b1d-c06e-4515-a9ea-b00bd9245f9d for instance 78d77c88-2507-41f1-a8bf-604880929568 on hv-cinder-85625 Sep 07 13:36:38.293881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:38.294002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-b40f3704-062a-4daf-9173-6c33d5e64893 req-e85e337a-f307-4e2d-bb33-d1beb61a8d9c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070923 Sep 07 13:36:38.294002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 244/485] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:36:38.297748 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:38.300087 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:38.303178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6e2430ee-09dc-4f28-a568-f59960f1865d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.401057 Sep 07 13:36:38.303659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 242/486] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:37 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:39.160783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:39.161834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 57347a10-9415-44b7-a4e0-d588355cc98f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:39.170312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:39.170817 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:39.171300 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:39.172036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:39.172542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:39.173000 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:39.196641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] HTTP exception thrown: Instance 57347a10-9415-44b7-a4e0-d588355cc98f could not be found. Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Request method failure captured: Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f HTTP/1.1 Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ33ORsrlEYoH8_r_P-KufUpFlClaIPhCgnVEcWu85lRapOeHMVbPgRl7DgP4celLkQ86bFaU_iefC_0x_3qqUc8f1kh3TPyKTKT3MpNbIOKakzOOoYLtdCnI7j4K2aGvHhUgUJRvyXHtGn8-m_PFDIJTyY4Ei3AvSdBm8ZoOBR-6Ug Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: e0b6de13e7c64cbdb0f43bddfaebc4ba Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesSnapshotTestJSON-9303285 Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:36:39.198770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0b6de13e7c64cbdb0f43bddfaebc4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0b6de13e7c64cbdb0f43bddfaebc4ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0b6de13e7c64cbdb0f43bddfaebc4ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0b6de13e7c64cbdb0f43bddfaebc4ba", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesSnapshotTestJSON-9303285 Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: e0b6de13e7c64cbdb0f43bddfaebc4ba Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-9303285 Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesSnapshotTestJSON-9303285-project Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 6dcde357754a4f668c30c40dc838d09f Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesSnapshotTestJSON-9303285-project Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 57347a10-9415-44b7-a4e0-d588355cc98f could not be found. Sep 07 13:36:39.201241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '57347a10-9415-44b7-a4e0-d588355cc98f'} Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57347a10-9415-44b7-a4e0-d588355cc98f could not be found. Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:36:39.202599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57347a10-9415-44b7-a4e0-d588355cc98f could not be found. Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57347a10-9415-44b7-a4e0-d588355cc98f could not be found. Sep 07 13:36:39.205042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:39.207381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Returning 404 to user: Instance 57347a10-9415-44b7-a4e0-d588355cc98f could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:36:39.207381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-634b2d71-8829-4f59-921f-1917b51db7d1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f" status: 404 len: 111 microversion: 2.1 time: 0.049388 Sep 07 13:36:39.207381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 245/487] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:39 2022] GET /compute/v2.1/servers/57347a10-9415-44b7-a4e0-d588355cc98f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:36:39.341281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:39.342520 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:39.356278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:39.357718 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:39.361711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:39.361711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:39.361711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:39.363049 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:39.634256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:39.662737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:39.665002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:39.666859 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-65c269cd-c2d3-4cba-9d4f-1605c721a1be tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.336384 Sep 07 13:36:39.668060 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 243/488] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:39 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:40.709931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:40.710554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:40.717972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:40.718610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:40.719136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:40.719914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:40.720415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:40.720889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:40.929807 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:40.941658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:40.944507 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:40.946011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-47e562e9-6ca7-4e18-928b-3eaa2a6bc150 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.240362 Sep 07 13:36:40.946607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 246/489] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:40 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:41.770253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8f2c7cf-8bb4-4ed7-9713-62ae92f74734"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:41.773123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:41.781564 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:41.782079 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:41.782535 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:41.783706 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:41.784234 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:41.784731 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:41.979294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:41.980162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:41.989785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:41.990351 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:41.990858 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:41.991709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:41.992231 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:41.992843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:42.184088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:42.194247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:42.195732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:42.196970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5f091bcb-d276-4ef8-8e64-5d8da857022d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.222475 Sep 07 13:36:42.197532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 247/490] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:41 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:43.006405 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:43.007356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:43.018775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:43.019716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:43.021137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:43.026734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:43.026734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:43.026734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:43.142718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lazy-loading 'services' on Instance uuid cd3d8fa7-7daf-4ceb-9906-985ba2fe332f {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:43.488176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-48cc8f6b-e736-439d-8c98-38d7f9f3916b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-volume_attachments/07c07715-1fdc-4aec-8f7e-e56d838a6719" status: 202 len: 0 microversion: 2.1 time: 0.490207 Sep 07 13:36:43.489200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 248/491] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:36:42 2022] DELETE /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-volume_attachments/07c07715-1fdc-4aec-8f7e-e56d838a6719 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:36:43.499451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:43.500232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:43.508328 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:43.508856 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:43.509393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:43.510204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:43.510705 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:43.511300 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:43.748165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:43.759701 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:43.762119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:43.764228 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-946ae06b-ffa9-4b9b-9cdc-62f439710f66 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.269709 Sep 07 13:36:43.765271 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 249/492] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:43 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:44.798950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:44.799644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:44.808579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:44.809101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:44.809538 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:44.810307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:44.811078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:44.811264 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:45.017591 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:45.029735 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:45.031408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:45.033054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-efef4bcd-1993-441f-966f-d23a16597375 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.238691 Sep 07 13:36:45.033671 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 250/493] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:44 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:45.737496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:45.738336 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:45.752433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:45.753242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:45.753987 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:45.756787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:45.757648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:45.758364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:45.794410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-be85b974-77a5-4844-a57b-d94e6e3c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7/ips" status: 200 len: 149 microversion: 2.1 time: 0.063952 Sep 07 13:36:45.795508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 251/494] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:36:45 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7/ips => generated 149 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:36:45.812160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e201ba2f-d483-40ca-bbc8-98046971bbda"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:45.815690 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:45.828195 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:45.829261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:45.829931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:45.831208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:45.832040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:45.832926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:45.854372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:45.952349 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Invalid volume: volume e201ba2f-d483-40ca-bbc8-98046971bbda is already attached to instances: 9b3f1350-9b24-4671-8770-5bdc7f6921a1 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: POST /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7/os-volume_attachments HTTP/1.1 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 74 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:36:45.963786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {"volumeAttachment": {"volumeId": "e201ba2f-d483-40ca-bbc8-98046971bbda"}} Sep 07 13:36:45.966674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Invalid volume: volume e201ba2f-d483-40ca-bbc8-98046971bbda is already attached to instances: 9b3f1350-9b24-4671-8770-5bdc7f6921a1 Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'server_id': '4e1621bb-92bb-4e45-8381-6c5759220ab7', 'body': {'volumeAttachment': {'volumeId': 'e201ba2f-d483-40ca-bbc8-98046971bbda'}}} Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e201ba2f-d483-40ca-bbc8-98046971bbda is already attached to instances: 9b3f1350-9b24-4671-8770-5bdc7f6921a1 Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:45.968115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e201ba2f-d483-40ca-bbc8-98046971bbda is already attached to instances: 9b3f1350-9b24-4671-8770-5bdc7f6921a1 Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:45.970282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e201ba2f-d483-40ca-bbc8-98046971bbda is already attached to instances: 9b3f1350-9b24-4671-8770-5bdc7f6921a1 Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 400 to user: Invalid volume: volume e201ba2f-d483-40ca-bbc8-98046971bbda is already attached to instances: 9b3f1350-9b24-4671-8770-5bdc7f6921a1 {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9cac4ae5-0a73-4754-8c09-7852fcffe85b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149810 Sep 07 13:36:45.972970 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 252/495] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:36:45 2022] POST /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:36:45.974420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:45.974420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:45.979075 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:45.979578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:45.980019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:45.980735 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:45.981189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:45.981614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:46.013208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:36:46.481041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-17e61763-1237-4922-a947-024816dfdb66 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 204 len: 0 microversion: 2.1 time: 0.518967 Sep 07 13:36:46.482267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 253/496] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:36:45 2022] DELETE /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:36:46.494958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:46.495714 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:46.502501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:46.503083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:46.503552 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:46.504281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:46.505546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:46.506002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:46.697218 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:46.710145 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:46.712221 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:46.713610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7526263f-5a56-4c48-a08c-812d44f7e908 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.229461 Sep 07 13:36:46.714313 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 254/497] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:46 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:46.724776 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:46.726136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:46.738964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:46.739912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:46.740752 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:46.742123 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:46.745680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:46.750314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:46.955914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:46.957269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-439bb25c-1453-484f-97d4-fc0982631ab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.191490 Sep 07 13:36:46.959641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 244/498] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:36:41 2022] POST /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments => generated 194 bytes in 5195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:36:46.974005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-605fad35-ec75-4a30-8c8c-5224695ed81b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1677 microversion: 2.1 time: 0.257154 Sep 07 13:36:46.975083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 255/499] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:46 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1677 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:47.768482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:47.770921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:47.789195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:47.790076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:47.791267 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:47.792609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:47.793513 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:47.794323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:48.025047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:48.027539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:48.045922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:48.047261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:48.049186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:48.052522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:48.054107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:48.054931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:48.127490 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:48.150665 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:48.154591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:48.157162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7e839883-431c-467b-886d-a7058bacb8cd tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.398581 Sep 07 13:36:48.158621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 245/500] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:47 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:48.434715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:48.468383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a75297b3-a11a-46e4-8081-c2d770ddac60 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1677 microversion: 2.1 time: 0.453944 Sep 07 13:36:48.470078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 256/501] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:48 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1677 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:49.207236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:49.212071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:49.246376 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:49.248419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:49.250269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:49.252416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:49.254173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:49.258474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:49.529021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:49.531733 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:49.548993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:49.550398 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:49.552464 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:49.554281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:49.557825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:49.559394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:49.790453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:49.834440 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:49.841824 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:49.845260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-681ccfee-99ad-4bf0-8acf-4e57e204701a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.645117 Sep 07 13:36:49.847094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 246/502] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:49 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:50.190246 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:50.232394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7120d4bb-3448-4f43-91af-9f9510e4e002 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1677 microversion: 2.1 time: 0.707138 Sep 07 13:36:50.233316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 257/503] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:49 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1677 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:50.910047 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:50.914365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:50.930221 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:50.932022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:50.932899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:50.934161 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:50.935008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:50.935904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:51.279578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:51.280393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:51.282043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:51.295648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:51.297332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:51.298697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:51.299300 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:51.300733 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:51.302065 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:51.303119 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:51.303896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:51.306182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5aaf77ff-771a-4f3b-bbbb-b91b8ded9f4b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1810 microversion: 2.20 time: 0.407225 Sep 07 13:36:51.319030 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 247/504] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:50 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1810 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:36:51.869986 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:51.888547 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c05399b0-5e96-417a-9ecd-6aa175a45793 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1677 microversion: 2.1 time: 0.618444 Sep 07 13:36:51.890391 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 258/505] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:51 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1677 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:52.359920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:52.361918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:52.396942 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:52.396942 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:52.396942 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:52.398470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:52.400910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:52.402303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:52.762658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:52.788120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:52.793739 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:52.797761 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fb4f2539-b0f5-4667-aa27-16e73a84a83a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1797 microversion: 2.20 time: 0.444351 Sep 07 13:36:52.799257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 248/506] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:36:52 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1797 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:36:52.933343 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:52.935987 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:52.957009 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:52.961049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:52.962795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:52.964591 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:52.965976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:52.967130 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:53.216667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:53.267506 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-39765aaa-a9ab-41ee-bdc8-6d2fe99d7d41 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1610 microversion: 2.1 time: 0.328962 Sep 07 13:36:53.296374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 259/507] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:52 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1610 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:53.457304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-68b1a7f1-6d18-4ceb-9801-f51d1fc10e7c req-a91ea581-efb1-46f1-a24a-4934ce9a180c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1621bb-92bb-4e45-8381-6c5759220ab7", "name": "network-vif-deleted", "tag": "c97fd6b8-038b-4dc0-8912-88161fd117e9"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:53.497499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-68b1a7f1-6d18-4ceb-9801-f51d1fc10e7c req-a91ea581-efb1-46f1-a24a-4934ce9a180c service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:53.498927 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-68b1a7f1-6d18-4ceb-9801-f51d1fc10e7c req-a91ea581-efb1-46f1-a24a-4934ce9a180c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:53.499971 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-68b1a7f1-6d18-4ceb-9801-f51d1fc10e7c req-a91ea581-efb1-46f1-a24a-4934ce9a180c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:53.540316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-68b1a7f1-6d18-4ceb-9801-f51d1fc10e7c req-a91ea581-efb1-46f1-a24a-4934ce9a180c service nova] Creating event network-vif-deleted:c97fd6b8-038b-4dc0-8912-88161fd117e9 for instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 on hv-cinder-85625 Sep 07 13:36:53.551233 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-68b1a7f1-6d18-4ceb-9801-f51d1fc10e7c req-a91ea581-efb1-46f1-a24a-4934ce9a180c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101677 Sep 07 13:36:53.554627 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 249/508] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:54.326342 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:54.333680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:54.370843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:54.371852 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:54.372941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:54.376405 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:54.377546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:54.378609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:54.466234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:54.467588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:54.468637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:54.469724 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'fault' on Instance uuid 4e1621bb-92bb-4e45-8381-6c5759220ab7 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:54.617217 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:54.640522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1c49cf63-66d7-477a-8c69-40027ed206bb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1328 microversion: 2.1 time: 0.321501 Sep 07 13:36:54.642277 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 260/509] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:54 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:54.975299 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1506613838", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "networks": [{"uuid": "f21941dd-5dfd-4258-80fa-2a9f8f6ea3df"}]}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:55.080422 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=56 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:55.253746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] validate_networks() for [('f21941dd-5dfd-4258-80fa-2a9f8f6ea3df', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:36:55.291121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-44d46952-0261-4813-85b0-7b5ac90a4380 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:55.334349 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44d46952-0261-4813-85b0-7b5ac90a4380 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:55.349355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44d46952-0261-4813-85b0-7b5ac90a4380 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:55.350551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44d46952-0261-4813-85b0-7b5ac90a4380 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:55.469519 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-44d46952-0261-4813-85b0-7b5ac90a4380 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Going to try to stop instance {{(pid=151551) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:36:55.878294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-44d46952-0261-4813-85b0-7b5ac90a4380 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action" status: 202 len: 0 microversion: 2.1 time: 0.592986 Sep 07 13:36:55.886066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 261/510] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:36:55 2022] POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:36:55.908906 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:55.925121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:55.969820 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:55.972518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:55.978314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:55.990204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:55.990204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:55.990204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:56.134599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:56.135418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:56.136114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:56.137489 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'fault' on Instance uuid 4e1621bb-92bb-4e45-8381-6c5759220ab7 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:36:56.252840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:56.270699 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4163eb7c-9785-4335-8769-3044a08cfe13 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 200 len: 1328 microversion: 2.1 time: 0.375483 Sep 07 13:36:56.272674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 262/511] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:55 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 1328 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:56.282530 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:56.283779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:56.317798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:56.319986 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:56.323790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:56.326071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:56.328834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:56.344498 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:56.746443 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:36:56.751044 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:36:56.751044 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:36:56.752890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:36:56.762941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:36:56.786662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:56.787763 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:56.789095 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:56.791432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:56.792696 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:56.793706 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:56.924822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Getting quotas for project e0b6de13e7c64cbdb0f43bddfaebc4ba. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:36:56.951138 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Getting quotas for user 6dcde357754a4f668c30c40dc838d09f and project e0b6de13e7c64cbdb0f43bddfaebc4ba. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:36:56.996032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:36:57.003817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:36:57.162921 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:57.198915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-92890227-0a64-41f7-ad34-2c824edec22e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.923819 Sep 07 13:36:57.221833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 263/512] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:56 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:57.263977 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-882d2905-c8ec-4dee-b5fd-d825593a492c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.316442 Sep 07 13:36:57.265993 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 250/513] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:36:57.288992 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6cc8a2b6-586b-4534-86b3-d626f2ecdb2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:57.290953 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6cc8a2b6-586b-4534-86b3-d626f2ecdb2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:57.327493 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:57.329938 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:57.368773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:57.369677 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:57.370525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:57.382579 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:57.383754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:57.387391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:57.437177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 HTTP/1.1 Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:36:57.441203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:36:57.444754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '4e1621bb-92bb-4e45-8381-6c5759220ab7'} Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:36:57.446622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:36:57.449356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:36:57.456302 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:36:57.456758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b9d415da-8813-4c81-9ada-e8353a61efab tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 404 len: 111 microversion: 2.1 time: 0.139159 Sep 07 13:36:57.466550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 251/514] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:57 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:36:57.478681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2a6c4d4f-8ad4-489b-8657-fb65268f348e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '.version_select at 0x7f1747d80c10>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:57.537102 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6cc8a2b6-586b-4534-86b3-d626f2ecdb2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:57.574559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6cc8a2b6-586b-4534-86b3-d626f2ecdb2e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1219 microversion: 2.1 time: 0.294719 Sep 07 13:36:57.576412 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 264/515] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:57 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1219 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:57.615628 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2a6c4d4f-8ad4-489b-8657-fb65268f348e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142890716" status: 202 len: 0 microversion: 2.1 time: 0.146374 Sep 07 13:36:57.616707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 252/516] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:36:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142890716 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:36:58.251556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:58.252955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:58.267949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:58.268603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:58.284259 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:58.285753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:58.305843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:58.307198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:58.625174 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-853e1470-1f94-4b8e-aec2-4caf7d71c32d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:58.626213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-853e1470-1f94-4b8e-aec2-4caf7d71c32d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:58.845900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-853e1470-1f94-4b8e-aec2-4caf7d71c32d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:58.852955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:58.875412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-853e1470-1f94-4b8e-aec2-4caf7d71c32d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1219 microversion: 2.1 time: 0.256841 Sep 07 13:36:58.877489 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 253/517] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:58 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1219 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:58.880442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f0f4b549-e089-4978-95f6-d48e8bbbf526 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.636234 Sep 07 13:36:58.883605 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 265/518] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:58 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:59.926943 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:59.930238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:59.932224 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:59.933029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:59.954869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:59.955439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:59.955645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:59.956332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:59.957645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:59.958660 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:59.959255 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:59.960220 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:59.960919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:59.961371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:59.962766 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:59.963303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:00.079253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:00.109681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c2b5e115-253d-4956-b162-8b37671ea34b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1223 microversion: 2.1 time: 0.199191 Sep 07 13:37:00.111380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 254/519] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:59 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1223 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:00.122103 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:00.123537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:00.136188 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:00.137544 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:00.138688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:00.140591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:00.141865 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:00.142930 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:00.217160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:00.237368 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:00.258281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bd802ece-584a-40bf-9bc5-6ef33ad1befd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.331613 Sep 07 13:37:00.258281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 266/520] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:59 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:00.360005 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'services' on Instance uuid 9b3f1350-9b24-4671-8770-5bdc7f6921a1 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:00.969014 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ad12f516-5f1c-448e-abc1-8433d2906fb7 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments/e201ba2f-d483-40ca-bbc8-98046971bbda" status: 202 len: 0 microversion: 2.1 time: 0.852982 Sep 07 13:37:00.971453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 255/521] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:37:00 2022] DELETE /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments/e201ba2f-d483-40ca-bbc8-98046971bbda => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:37:00.982315 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:00.986059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:00.995694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:00.996575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:00.997383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:00.998697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:00.999481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.000033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.047812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5dd83cc3-f416-4b42-ae42-25e77877a8d3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070325 Sep 07 13:37:01.048932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 267/522] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:00 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:01.154495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:01.157960 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:01.166876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:01.167944 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.169416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.170707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:01.171565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.172087 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.260888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:01.263801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:01.273425 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-69f4eb05-c02e-441e-8713-865c9806e4a4 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.123356 Sep 07 13:37:01.274554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 256/523] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:01 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:01.292569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:01.294021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:01.302873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:01.303811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.304926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.306120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:01.307007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.307681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.508551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:01.518948 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7318f557-71b2-4f2f-b206-e31d54a028bb tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.231623 Sep 07 13:37:01.520227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 268/524] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:01 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:02.175525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:02.175525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:02.175525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.175525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.176914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:02.176914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.176914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.176914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:02.177238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3dbae2da-e000-4166-8474-b660e5ec8cd3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055158 Sep 07 13:37:02.177238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 257/525] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:02 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:02.321775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:02.325684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:02.334646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.336044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.336857 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:02.338092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.338609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.339662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:02.443203 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:02.458188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d423397d-bfbd-4c40-83fb-65b762c16c66 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.149128 Sep 07 13:37:02.460370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 269/526] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:02 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:02.551466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:02.553052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:02.565593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.567354 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.568472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:02.569809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.570966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.572123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:02.833554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:02.845948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7f11995c-3622-4444-8b5a-2fab1cad2775 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.302605 Sep 07 13:37:02.847071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 258/527] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:02 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:03.195694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:03.199928 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:03.210222 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:03.210730 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:03.211244 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:03.211976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:03.212457 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:03.212893 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:03.260076 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-420a754d-6bb5-4f9c-90f3-a8e762b0d396 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073025 Sep 07 13:37:03.261150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 270/528] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:03 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:03.501596 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:03.502656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:03.516085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:03.516937 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:03.517975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:03.520360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:03.521199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:03.521934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:03.637662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:03.653356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c09a73b5-8ce9-4eec-85da-9e3b4da964ca tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.158632 Sep 07 13:37:03.654740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 259/529] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:03 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:03.889371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:03.903673 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:03.911825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:03.913338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:03.914631 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:03.917086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:03.918798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:03.920232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.138344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:04.157018 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-581d56e8-9be7-4bb1-9211-9b6426097a8d tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.279234 Sep 07 13:37:04.157877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 271/530] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:03 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:04.275909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:04.278739 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:04.290583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.291308 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.292175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.293254 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.293715 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.294217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.333268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6e07b20b-f234-4fa2-9659-ce65f67ac552 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061601 Sep 07 13:37:04.334208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 260/531] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:04 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:04.714530 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:04.715511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:04.723188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.724263 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.724753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.725549 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.726038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.726499 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.815825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:04.831126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-eafef809-d5e9-4a10-a4b4-825be33ff3b3 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.120266 Sep 07 13:37:04.833081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 272/532] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:04 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:05.195445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:05.196599 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:05.214330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.215163 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.216088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:05.217207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.218143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.218929 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:05.366840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:05.386310 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:05.404435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:05.413346 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.419378 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.420603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:05.421943 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.423650 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.424143 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:05.457946 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:05.469636 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8d3ab9f2-40ec-4823-ad37-ccd940104fc7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.284704 Sep 07 13:37:05.470912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 261/533] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:05 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:05.526417 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2ce25c73-9bae-4f42-a83c-e03fad96294c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183646 Sep 07 13:37:05.532318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 273/534] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:05 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:05.869635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:05.870953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:05.883727 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.884588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.884588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:05.886588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.887529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.888747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.005034 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:06.020896 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cc53aafa-ae56-4005-961e-70c73d7d5d03 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.159343 Sep 07 13:37:06.021989 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 262/535] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:05 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:06.502638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:06.504040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:06.519701 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.520584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.521638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.523105 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.523951 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.524721 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.549862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:06.559347 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:06.584001 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.595298 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.597441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.599190 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.600355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.601774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.675067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2fa3993a-d77b-4880-8d2c-ede6ba17f9db tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132332 Sep 07 13:37:06.682920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 263/536] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:06 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:06.770255 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:06.789595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-875bdbbc-95a0-4f55-b5a9-de791189ec9c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.294159 Sep 07 13:37:06.791126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 274/537] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:06 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:07.068191 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:07.069605 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:07.075949 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:07.084510 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.085551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.086368 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.087621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.093597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.093597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.218081 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:07.243410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cca79ba6-3377-437c-956b-e0da1b3e4d16 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.184360 Sep 07 13:37:07.244552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 264/538] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:07 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:07.691923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:07.695811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:07.703319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:07.706626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.706626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.707743 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.708770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.709653 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.710388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.773173 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7f99b00f-ba25-4adc-b358-08283435a17a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085994 Sep 07 13:37:07.782026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 275/539] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:07 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:07.831801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:07.834882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:07.855076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.856271 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.857284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.859123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.860250 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.861556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:08.107078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:08.134587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bd5d6779-d317-4c29-b2b4-d25dcc144364 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.318889 Sep 07 13:37:08.136457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 265/540] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:07 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:08.294290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:08.295485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:08.307348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:08.308061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:08.308667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:08.309745 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:08.310372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:08.311102 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:08.469520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:08.496582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7d130c13-b4ba-4f67-a71c-afcfa2388b49 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.209865 Sep 07 13:37:08.499773 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 276/541] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:08 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:08.802597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:08.805968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:08.823443 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:08.824472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:08.825130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:08.826125 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:08.826989 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:08.827661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:08.867600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=8 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:08.890752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5d2a00ea-278c-49f1-b9e1-7ac2e1f05f39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100528 Sep 07 13:37:08.893439 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 266/542] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:08 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:09.197112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:09.199544 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:09.213293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.214781 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.215767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.217404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.220320 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.220320 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.510424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:09.543470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:09.543730 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d35869e9-9394-4a89-927e-beb00da905ec tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.336477 Sep 07 13:37:09.559732 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:09.559955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 277/543] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:09 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:09.583130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.583130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.583130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.583130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.584009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.584009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.692595 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:09.729903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-50d5c21b-a82e-411b-a86d-fdb3e4ca100e tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.195500 Sep 07 13:37:09.729903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 267/544] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:09 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:09.907423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:09.914150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:09.922411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.923126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.930113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.930113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.930693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.931501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.978964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-86802048-384e-4660-8401-0eb517640811 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077372 Sep 07 13:37:09.979999 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 278/545] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:09 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:10.617032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:10.618103 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:10.650344 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:10.655653 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:10.655653 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:10.656229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:10.656840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:10.657740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:10.770808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:10.770808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:10.780369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:10.780369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:10.780369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:10.781715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:10.782335 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:10.782894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:10.909605 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:10.923942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5c585377-bf89-445e-a306-7215187b3832 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.161705 Sep 07 13:37:10.925196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 279/546] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:10 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:10.998028 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:11.002120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:11.009684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:11.014824 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:11.015973 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:11.016744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:11.017924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:11.018846 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:11.020562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:11.032120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9cdab09c-5519-4195-bb14-b59623898596 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.422213 Sep 07 13:37:11.034226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 268/547] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:10 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:11.085426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6ca6a797-0d0b-47e1-95b9-25537c6048f0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093680 Sep 07 13:37:11.086026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 280/548] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:10 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:11.960434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:11.961474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:11.980508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:11.982805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:11.984023 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:11.986048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:11.987556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:11.990325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.073397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:12.074795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:12.109393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.110207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.111232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.114795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.115994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.116947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.162962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:12.202828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e9bbcd4d-47bd-47d9-9195-6d84353929f6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.251720 Sep 07 13:37:12.228056 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 269/549] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:11 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:12.248844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:12.252817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:12.272270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.273180 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.273929 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.277206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.278281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.279233 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.354852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-10c0fa83-cbd8-4bb2-8d89-32df803c44ff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124984 Sep 07 13:37:12.355397 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 270/550] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:12 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:12.410436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:12.432800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bcb1b447-9d06-4821-bf73-2927ecaa2255 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.368160 Sep 07 13:37:12.434375 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 281/551] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:12 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:13.256084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:13.257284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:13.265474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:13.266194 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:13.266821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:13.267865 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:13.268510 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:13.269097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:13.369945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:13.373039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:13.375914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:13.381316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:13.382194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:13.383032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:13.383792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:13.384294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:13.384837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:13.391417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-db55614f-8af4-4c6a-97c7-2f833a92d5b6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.140138 Sep 07 13:37:13.407270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 271/552] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:13 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:13.429745 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f0e78124-381c-47e0-8132-7abda624eec6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064530 Sep 07 13:37:13.430708 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 282/553] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:13 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:13.482917 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:13.484271 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:13.494870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:13.495664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:13.496565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:13.497720 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:13.498455 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:13.499160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:13.739541 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:13.750260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-40e0c95d-518a-4789-a2c5-88cc72bf28d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1675 microversion: 2.1 time: 0.275013 Sep 07 13:37:13.751480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 272/554] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:13 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:14.448681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:14.452801 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:14.454087 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:14.454271 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:14.465284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:14.466012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:14.466787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:14.468722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:14.469832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:14.471256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:14.482019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:14.483174 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:14.484153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:14.499695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:14.499695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:14.499695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:14.500224 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:14.556431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-02072d86-7455-4f54-a44d-7045a115cc6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117107 Sep 07 13:37:14.557984 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 273/555] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:14 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:14.615213 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=100 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:14.696909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:14.747678 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-efb8b289-fe70-4b5c-b6d6-ebfef62c5860 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1271 microversion: 2.1 time: 0.313735 Sep 07 13:37:14.748338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 283/556] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:14 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1271 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:14.793243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:14.794082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:14.810046 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:14.811014 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:14.811852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:14.813154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:14.814022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:14.815298 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.020500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:15.035739 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-58202753-5faa-4d29-9d15-fb8a7993213e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1652 microversion: 2.1 time: 0.246557 Sep 07 13:37:15.037108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 274/557] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:14 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1652 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:15.080945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d7cd24a4-b357-4bb4-830d-722d51a6c335 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:15.093646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d7cd24a4-b357-4bb4-830d-722d51a6c335 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:15.094538 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d7cd24a4-b357-4bb4-830d-722d51a6c335 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:15.095729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d7cd24a4-b357-4bb4-830d-722d51a6c335 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.153310 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d7cd24a4-b357-4bb4-830d-722d51a6c335 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Going to try to start instance {{(pid=151551) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:37:15.472511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d7cd24a4-b357-4bb4-830d-722d51a6c335 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action" status: 202 len: 0 microversion: 2.1 time: 0.398610 Sep 07 13:37:15.474018 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 284/558] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:37:15 2022] POST /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:37:15.486312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:15.487466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:15.497226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:15.497890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:15.499136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.499878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:15.500606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:15.501205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.587438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:15.591583 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:15.619976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:15.627253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:15.627253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.627253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:15.628157 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:15.629474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.700040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4848529a-b269-4836-91e0-19e0013228ce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128758 Sep 07 13:37:15.701124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 285/559] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:15 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:15.780061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:15.785579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:15.794902 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:15.796013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:15.796874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.798153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:15.799672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:15.801333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:15.825816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:15.862578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-643bf1ae-9b86-496e-b58f-9e386d1df9c5 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.381186 Sep 07 13:37:15.867020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 275/560] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:15 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:16.024053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:16.036582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-144b1551-0e63-4809-9394-81e0a8c6fd0b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1279 microversion: 2.1 time: 0.264958 Sep 07 13:37:16.039313 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 286/561] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:15 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1279 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:16.488503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:16.492324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:16.501196 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:16.501923 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:16.502725 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:16.504702 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:16.505637 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:16.506177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:16.543548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'flavor' on Instance uuid 42374ed7-b063-4892-b40a-da27fb0779ce {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:16.714879 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:16.719697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:16.728198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:16.729398 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:16.729938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:16.730689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:16.731190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:16.731833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:16.803329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-914bf263-66dc-4a9e-a00f-74ee6d696bff tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091813 Sep 07 13:37:16.811173 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 287/562] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:16 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:16.918904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:16.919767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:16.929896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:16.930725 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:16.933983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:16.933983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:16.933983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:16.933983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:17.170458 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-61b9c870-1e62-4da0-a4fd-4a641625034c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/action" status: 200 len: 32 microversion: 2.1 time: 0.686100 Sep 07 13:37:17.171846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 276/563] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:37:16 2022] POST /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/action => generated 32 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:37:17.184264 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:17.185238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:17.197427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:17.198250 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:17.198902 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:17.199990 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:17.200909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:17.202329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:17.425281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:17.435801 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-978fe8c1-a42a-4b92-8ebc-865d627baf03 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.522561 Sep 07 13:37:17.436662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 288/564] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:16 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:17.445955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:17.447331 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:17.458017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:17.465622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:17.466394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:17.467072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:17.468359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:17.469024 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:17.469606 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:17.471232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d3ea0f89-f400-4cdf-93a2-a9e07317d00b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.297304 Sep 07 13:37:17.472061 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 277/565] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:17 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:17.685040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:17.695712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-67bfd5a4-ad19-45bd-bff7-1b18281ec322 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.257270 Sep 07 13:37:17.696388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 289/566] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:17 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:17.821783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:17.824286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:17.832463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:17.833178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:17.833632 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:17.834335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:17.834794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:17.835319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:17.870441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3d4df5cf-33bd-4381-9516-701ade8525e4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054811 Sep 07 13:37:17.871192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 278/567] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:17 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:18.478682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:18.479924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:18.489274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.490034 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.490714 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.491869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.492537 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.493131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.513381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:18.515060 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:18.526712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.527671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.528755 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.530076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.530937 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.532022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.663890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:18.679309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-98b3797c-448e-4dfa-a40f-1fff48543a8a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.205274 Sep 07 13:37:18.680152 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 290/568] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:18 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:18.726519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:18.727693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:18.728818 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:18.735606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d0742f6e-70e2-43b2-86e3-cc741d7d371c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.237529 Sep 07 13:37:18.736288 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 279/569] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:18 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:18.739211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.740100 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.741119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.742524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.743430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.744212 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.885414 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:18.888031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:18.896498 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.896992 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.897437 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.898184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:18.898644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:18.899243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:18.940503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dab2be4b-c3c5-49b6-8b3e-b5fa057a89a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058526 Sep 07 13:37:18.940881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 280/570] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:18 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:18.947715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:18.962266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7057cf86-752b-48f6-b6cc-b435107beebd tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.241838 Sep 07 13:37:18.963288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 291/571] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:18 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:19.707070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:19.707718 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:19.715068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:19.715575 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:19.716022 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:19.716764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:19.717244 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:19.717668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:19.785520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:19.785520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:19.785520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:19.785520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:19.786771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:19.786771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:19.786771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:19.786771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:19.923855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:19.944092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1c1fac7a-fce6-4b01-9393-1c62448e7b8e tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.241308 Sep 07 13:37:19.949946 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 281/572] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:19 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:19.958400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:19.961253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:19.968892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:19.969508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:19.970036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:19.970888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:19.971416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:19.971877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:20.012978 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:20.025667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1e922017-0ca4-4e45-9506-dc95b50701d6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.267411 Sep 07 13:37:20.026649 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 292/573] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:19 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:20.032235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d42b6012-d323-4f4d-96f1-df1dec22fbe6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079093 Sep 07 13:37:20.033501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 282/574] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:19 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:20.033694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:20.035480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:20.045044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:20.045905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:20.046691 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:20.048063 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:20.048899 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:20.049678 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:20.320089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:20.336279 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9b6acfd0-7b62-4e22-a59c-112ec09974ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.307594 Sep 07 13:37:20.337083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 293/575] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:20 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:20.982132 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:20.983188 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:20.993165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:20.993657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:20.994184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:20.995015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:20.995850 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:20.996608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:21.052150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:21.054639 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:21.062475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:21.062998 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:21.063447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:21.064181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:21.064640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:21.065083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:21.109083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7655ec65-987e-46ea-9473-a2e26e322156 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061910 Sep 07 13:37:21.109700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 294/576] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:21 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:21.115422 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:21.116088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:21.125804 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:21.126590 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:21.127374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:21.129302 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:21.130181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:21.130933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:21.252697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:21.270132 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fb2daeb5-5b40-47b7-8c37-7560eb9e8d08 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.294229 Sep 07 13:37:21.288583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 283/577] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:20 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:21.375074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:21.382013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:21.382258 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:21.390047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-006437af-7af9-4d54-9940-966d040e99dc tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.278898 Sep 07 13:37:21.390944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 295/578] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:21 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:21.399554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:21.399554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:21.399554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:21.399554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:21.400130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:21.400130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:21.599626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:21.609700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d3560e75-b817-4a9b-a816-96339ecae818 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.236639 Sep 07 13:37:21.610345 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 284/579] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:21 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:22.126419 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:22.129289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:22.136705 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.138668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.138668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.138668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.138950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.139283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.181807 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fc2d24e2-9d33-4117-97e6-033e66b61488 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059569 Sep 07 13:37:22.182465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 296/580] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:22 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:22.319995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:22.320861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:22.332212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.334174 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.334905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.336169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.336975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.337709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.431119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:22.432863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:22.449703 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.451094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.451932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.453364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.454252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.455069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.684307 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:22.695690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a2479a39-1619-44e6-9e77-d783a0877032 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.385020 Sep 07 13:37:22.696389 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 285/581] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:22 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:22.703997 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:22.704990 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:22.717070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.717070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.717070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.718911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:22.719945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:22.720675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:22.730247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:22.744944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-80ee9ad0-6ac7-452b-bca0-f0574f4cecd9 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.322728 Sep 07 13:37:22.746373 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 297/582] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:22 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:22.950905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:22.981131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a3994092-32b4-4672-bdad-9dbf88cceab3 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.268691 Sep 07 13:37:22.981131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 286/583] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:22 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:23.200161 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:23.203661 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:23.215136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.221975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.221975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.221975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.221975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.223239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.276763 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c074218e-a72c-4497-8d14-029b77f9fa31 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083485 Sep 07 13:37:23.278318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 298/584] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:23 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:23.742199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:23.744108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:23.756431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.757323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.758181 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.759539 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.760533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.761335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.789498 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:23.791688 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:23.801652 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.802787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.803822 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.805428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.806534 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.807685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.817339 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:24.012557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:24.019961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9f8415ac-dd18-48f0-8a86-68899a1c98cd tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.285116 Sep 07 13:37:24.020405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 287/585] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:23 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:24.025926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:24.026718 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:24.035824 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:24.038851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:24.038851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:24.038851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:24.038851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:24.039435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:24.045289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:24.086575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:24.113591 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4d63cb45-b697-4e6e-bb84-5a88c892eef6 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.317626 Sep 07 13:37:24.116215 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 299/586] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:23 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:24.222670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:24.239008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-63667bfe-2c9e-4ba6-8b02-6c6f2555c374 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.216329 Sep 07 13:37:24.239008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 288/587] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:24 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:24.295020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:24.297424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:24.305416 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:24.305907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:24.306384 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:24.307170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:24.307644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:24.308051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:24.347817 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6e966480-20e5-4484-9b22-d08ef4351ebe tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056154 Sep 07 13:37:24.348949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 300/588] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:24 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:25.073486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:25.073486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:25.082707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.083678 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.084450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.085747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.086592 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.087564 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.132020 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:25.132803 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:25.141828 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.141828 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.142145 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.142882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.143392 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.147448 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.329593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:25.341961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ae7fe941-d374-4554-b263-297c995642e0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.283034 Sep 07 13:37:25.342792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 289/589] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:25 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:25.351730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:25.352855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:25.356315 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:25.370368 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.370958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.371623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.372499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.373117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.373703 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.429765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:25.439099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f72c9d67-210e-454f-b7d1-5da06eb56af8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.313655 Sep 07 13:37:25.439718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 301/590] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:25 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:25.463261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:25.467204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:25.480122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.481479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.482274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.483597 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.484445 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.485225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.526621 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-eb7ce8df-a522-496e-83e7-c88776c77a20 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073442 Sep 07 13:37:25.527575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 302/591] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:25 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:25.578257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:25.596051 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dedb7dbb-9d64-48f7-82bc-56d354e5a44f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.251448 Sep 07 13:37:25.596609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 290/592] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:25 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:26.378284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:26.380029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:26.387438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.387938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.388395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.389110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.389577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.390106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.466311 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:26.472952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:26.478125 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.478880 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.479589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.480713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.481487 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.482152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.918248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:26.930717 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b72932cb-8d9b-4d5f-ad68-183737f1e99f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.556717 Sep 07 13:37:26.956031 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 303/593] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:26 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:26.963711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:26.982645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:26.992973 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.994569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.995372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.997112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.997890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.998359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:26.998933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:27.018855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-76c2b190-cb0f-4cd9-acc7-8c49153c1c28 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.556378 Sep 07 13:37:27.020589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 291/594] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:26 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:27.032775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:27.034036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:27.049856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:27.049856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:27.049856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:27.051918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:27.052887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:27.053798 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:27.054478 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-89c5e330-66be-4234-863c-e253baeac9a3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095888 Sep 07 13:37:27.055615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 304/595] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:26 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:27.397460 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:27.411453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-392d6cf1-9d71-4c5a-8793-43561cc7d876 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.389067 Sep 07 13:37:27.412325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 292/596] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:27 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:27.984012 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:27.989784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:28.021381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.025509 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.026421 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.030473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.030473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.030473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.088225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:28.095146 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:28.120398 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.121519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.123801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.125332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.128658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.129521 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.376468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:28.388506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-609e72d8-319e-49d7-b35f-2525e7c3783b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.323970 Sep 07 13:37:28.389351 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 293/597] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:28 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:28.397700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:28.400961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:28.410946 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.411848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.412746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.413755 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.414292 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.415258 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.458687 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-44f4a4ca-20fb-4562-8677-2bc8e4fcf171 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066803 Sep 07 13:37:28.459404 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 294/598] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:37:28 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:37:28.468658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:28.471324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:28.487299 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.488239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.488393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.490531 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.491078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.493911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.672012 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:28.686475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-29572f46-0bbb-46b3-8359-731cb3596ba7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1661 microversion: 2.1 time: 0.726639 Sep 07 13:37:28.687790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 305/599] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:27 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1661 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:28.701107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:28.702042 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:28.717692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.718588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.719719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.721125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.722396 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:28.722754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.723543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.768177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0f84459f-6d35-4177-a8fb-4cbb1218b669 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.306218 Sep 07 13:37:28.771377 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 295/600] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:28 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:28.822860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:37:29.195464 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-57d44688-2d14-4919-994b-49f58ec77024 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 204 len: 0 microversion: 2.1 time: 0.505243 Sep 07 13:37:29.196623 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 306/601] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:37:28 2022] DELETE /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:37:29.203678 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-af46de48-394c-486f-a9dd-cbf104db5a04 req-535367f2-cb6e-49e3-9c40-15678804d381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca16a96-0541-4390-a233-dc6c347b9c92", "tag": "f7b08ccd-34e6-445f-aa4f-cb4cf44fd1a8"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:29.216811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:29.218614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:29.226342 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-af46de48-394c-486f-a9dd-cbf104db5a04 req-535367f2-cb6e-49e3-9c40-15678804d381 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.227283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-af46de48-394c-486f-a9dd-cbf104db5a04 req-535367f2-cb6e-49e3-9c40-15678804d381 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.228066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-af46de48-394c-486f-a9dd-cbf104db5a04 req-535367f2-cb6e-49e3-9c40-15678804d381 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.234948 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.237151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.239926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.242684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.245058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.253277 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.278197 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-af46de48-394c-486f-a9dd-cbf104db5a04 req-535367f2-cb6e-49e3-9c40-15678804d381 service nova] Creating event network-changed:f7b08ccd-34e6-445f-aa4f-cb4cf44fd1a8 for instance 8ca16a96-0541-4390-a233-dc6c347b9c92 on hv-cinder-85625 Sep 07 13:37:29.288495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-af46de48-394c-486f-a9dd-cbf104db5a04 req-535367f2-cb6e-49e3-9c40-15678804d381 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100308 Sep 07 13:37:29.290304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 296/602] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:29.421289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:29.423193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:29.434810 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.436002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.436779 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.438735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.439919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.440765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.466178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:29.468123 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f4ae5ec3-9e0b-4565-b874-1244d144a97e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1681 microversion: 2.1 time: 0.264184 Sep 07 13:37:29.468717 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 307/603] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:29 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:29.645941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:29.662017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2d51d470-f554-4898-bd0f-469d1daf9266 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.247818 Sep 07 13:37:29.663059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 297/604] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:29 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:29.740527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:29.741610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:29.752229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.754031 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.754797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.755964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.756662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.757303 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.819086 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:29.819802 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:29.826603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.827596 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.828173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.829085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:29.829675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:29.830230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.996407 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:30.015331 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7f633c3b-5af5-4148-b93b-07ed9d5e1338 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1665 microversion: 2.1 time: 0.283171 Sep 07 13:37:30.016924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 308/605] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:29 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1665 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:30.052043 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:30.063667 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dc9e4c5e-1dc0-4151-b68f-ecea47a40ea2 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.249368 Sep 07 13:37:30.064500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 298/606] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:29 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:30.501162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:30.502034 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:30.509685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:30.510331 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:30.510872 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:30.511851 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:30.512448 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:30.512993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:30.688149 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:30.689153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:30.696897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:30.697659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:30.700334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:30.701286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:30.703262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:30.703926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:30.719095 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:30.726191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-57bed7b2-ee62-4fa4-99b0-69d80a2d93e0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1681 microversion: 2.1 time: 0.229154 Sep 07 13:37:30.726850 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 309/607] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:30 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:31.061486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:31.084100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cf603fdd-c815-4c89-a229-dd8a170e84ac tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.394500 Sep 07 13:37:31.084100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 299/608] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:30 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:31.103485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:31.105060 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:31.118611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:31.119981 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:31.120744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:31.122169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:31.122904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:31.123708 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:31.497349 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:31.522341 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-11ec558e-b02e-405c-b692-6ad94ab9692b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.426364 Sep 07 13:37:31.523886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 310/609] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:31 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:31.776221 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:31.777756 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:31.788179 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:31.789029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:31.789920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:31.791673 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:31.792551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:31.793147 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.134674 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:32.136389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:32.159825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.174629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.174629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.174629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.174629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.175866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.253067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:32.260416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-806092fe-22ea-4320-b796-72fec2856155 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1681 microversion: 2.1 time: 0.498348 Sep 07 13:37:32.273953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 300/610] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:31 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1681 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:32.552720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:32.563923 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:32.564789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:32.567373 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e576946f-0e2c-49b3-9b6b-0aad90fb048f tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.448775 Sep 07 13:37:32.569298 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 311/611] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:32 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:32.580501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.582608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.583938 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.585308 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.586207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.587381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:33.015457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:33.032279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-128d98ab-7496-47ab-986c-e1e13a2dbdfe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.472713 Sep 07 13:37:33.047463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 301/612] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:32 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:33.306840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:33.306840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:33.314790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:33.319991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:33.319991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:33.319991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:33.319991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:33.321073 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:33.375879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-3a71c138-ce89-4c9e-84e0-1e2034ebe1f0 req-ef5ff034-5278-418a-9aea-a77e6a9613a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3f1350-9b24-4671-8770-5bdc7f6921a1", "name": "network-vif-deleted", "tag": "06a799cf-4ec2-424a-9ae1-0a28f235a093"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:33.390214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-3a71c138-ce89-4c9e-84e0-1e2034ebe1f0 req-ef5ff034-5278-418a-9aea-a77e6a9613a0 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:33.391115 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-3a71c138-ce89-4c9e-84e0-1e2034ebe1f0 req-ef5ff034-5278-418a-9aea-a77e6a9613a0 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:33.391701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-3a71c138-ce89-4c9e-84e0-1e2034ebe1f0 req-ef5ff034-5278-418a-9aea-a77e6a9613a0 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:33.431558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-3a71c138-ce89-4c9e-84e0-1e2034ebe1f0 req-ef5ff034-5278-418a-9aea-a77e6a9613a0 service nova] Creating event network-vif-deleted:06a799cf-4ec2-424a-9ae1-0a28f235a093 for instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 on hv-cinder-85625 Sep 07 13:37:33.433589 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:33.445850 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-3a71c138-ce89-4c9e-84e0-1e2034ebe1f0 req-ef5ff034-5278-418a-9aea-a77e6a9613a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076248 Sep 07 13:37:33.446070 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f9e1940f-71e5-4165-aa39-0c64bc73b0f2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1614 microversion: 2.1 time: 0.159768 Sep 07 13:37:33.447114 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 302/613] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:33.457247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 312/614] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:33 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1614 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:33.618756 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:33.620374 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:33.634125 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:33.635303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:33.640534 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:33.640534 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:33.640534 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:33.640534 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:33.884061 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:33.898876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4f8885dc-fb71-4189-bf88-f6d23aa72ed7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.292711 Sep 07 13:37:33.899697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 303/615] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:33 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:34.072189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:34.073582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:34.081983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.083174 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.083645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.084402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.084964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.085405 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.316502 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:34.328925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2b03c1f1-01b5-4fcf-853c-b82bf2909608 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.260818 Sep 07 13:37:34.329631 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 313/616] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:34 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:34.508273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:34.508273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:34.518591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.519918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.520354 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.521613 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.522800 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.523892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.607583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.608869 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.610142 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.611366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'fault' on Instance uuid 9b3f1350-9b24-4671-8770-5bdc7f6921a1 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:34.629516 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:34.630734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:34.663783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.665459 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.677057 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.678655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.679636 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.680427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.687768 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:34.742647 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:34.768352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0868c196-2176-40db-af9e-7cf55f1731af tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1331 microversion: 2.1 time: 0.275830 Sep 07 13:37:34.780388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 304/617] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:34 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1331 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:34.786471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-187a26a1-9322-4323-b3b2-f0071c31ff1d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments/9f905a6f-a126-4c22-99b7-f955db53e8b2" status: 200 len: 194 microversion: 2.20 time: 0.165165 Sep 07 13:37:34.791271 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 314/618] 10.222.0.62 () {60 vars in 1454 bytes} [Wed Sep 7 13:37:34 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments/9f905a6f-a126-4c22-99b7-f955db53e8b2 => generated 194 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:37:34.932153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:34.933519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:34.934795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:34.936190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:34.946215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.948159 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.949294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.951257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.952469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.956744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.965308 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.966187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.967015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.968289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.969113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.975268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.115920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:35.123472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lazy-loading 'services' on Instance uuid 78d77c88-2507-41f1-a8bf-604880929568 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:35.272715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:35.288713 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-387afab3-e71b-4e94-9cc3-fbe2d58ebbd8 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.360842 Sep 07 13:37:35.290309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 315/619] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:34 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:35.358338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:35.359982 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:35.373595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:35.374816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:35.375824 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.380976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:35.382175 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:35.384367 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.399717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-301f1b82-7f41-4da2-9198-2be84517573a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments/9f905a6f-a126-4c22-99b7-f955db53e8b2" status: 202 len: 0 microversion: 2.20 time: 0.475108 Sep 07 13:37:35.411852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 305/620] 10.222.0.62 () {60 vars in 1457 bytes} [Wed Sep 7 13:37:34 2022] DELETE /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments/9f905a6f-a126-4c22-99b7-f955db53e8b2 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:37:35.426296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:35.433621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:35.453869 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:35.454771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:35.455610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.457407 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:35.458407 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:35.459357 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.518239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-23c2bcd4-3992-4c0b-9347-522818719b86 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103700 Sep 07 13:37:35.519240 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 306/621] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 7 13:37:35 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:37:35.618582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:35.630385 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-35015b68-f0b2-44a9-9783-814815285718 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.276831 Sep 07 13:37:35.634061 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 316/622] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:35 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:35.816934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:35.818127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:35.828833 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:35.829741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:35.830537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.831947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:35.832801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:35.833559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.890471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:35.890884 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:35.891390 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:35.891900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'fault' on Instance uuid 9b3f1350-9b24-4671-8770-5bdc7f6921a1 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:35.958954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:35.968575 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-94bccd5f-17c5-4a89-a587-f2e3bce9907f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 200 len: 1331 microversion: 2.1 time: 0.159450 Sep 07 13:37:35.969217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 307/623] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:35 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:36.330160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:36.330160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:36.338106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:36.338602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:36.339374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:36.340415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:36.340896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:36.341336 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:36.540437 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:36.543343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:36.552515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:36.553021 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:36.555230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:36.555230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:36.556119 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:36.556816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:36.566009 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:36.589689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f91b0b4d-be7b-4a12-aba4-4af039bd425d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.266082 Sep 07 13:37:36.591381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 317/624] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:36 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:36.611277 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a9bf80e8-4ea8-4bc0-b0f2-d8b4fa094494 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075132 Sep 07 13:37:36.618392 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 308/625] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 7 13:37:36 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:37:36.687729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:36.688893 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:36.695502 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:36.702337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:36.710550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:36.710550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:36.710550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:36.710550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:36.711384 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:36.910651 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:36.922777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5b0fe449-e4e0-403b-a774-a2b683f159fe tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.242841 Sep 07 13:37:36.923460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 318/626] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:36 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:36.998290 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:36.999063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:37.009713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.010251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.010723 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.011912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.012676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.013370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.032067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 HTTP/1.1 Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:37:37.034076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:37:37.036333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '9b3f1350-9b24-4671-8770-5bdc7f6921a1'} Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:37:37.037310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:37:37.038858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:37:37.041163 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:37:37.041163 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-04a73ca5-bc82-44e4-afe1-8d62ec8cb7c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 404 len: 111 microversion: 2.1 time: 0.044024 Sep 07 13:37:37.041163 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 309/627] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:36 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:37:37.055806 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3f13687d-efac-47a7-bf12-090ad3c8a695 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '.version_select at 0x7f174c194a60>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:37.294918 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3f13687d-efac-47a7-bf12-090ad3c8a695 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709369045" status: 202 len: 0 microversion: 2.1 time: 0.247447 Sep 07 13:37:37.295999 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 319/628] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:37:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709369045 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:37:37.631755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:37.632715 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:37.634135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:37.638008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:37.646066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.647225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.647923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.648816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.649766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.651139 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.651736 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.652602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.653418 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.655120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.656391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.657165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.738649 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-522f5a3e-d70e-42fc-be0a-57039d2f119b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.114892 Sep 07 13:37:37.740255 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 310/629] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 7 13:37:37 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:37.871520 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:37.873074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:37.888803 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.889738 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:37.890592 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.891714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.894726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.896239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.897286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.903768 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-39217cdb-b716-4fd2-a7c0-e5e7587be37b tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.277333 Sep 07 13:37:37.908572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 320/630] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:37 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:37.950251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Going to try to terminate instance {{(pid=151552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:37:37.981410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:37.983729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:37.996647 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:37.997504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:37.998399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:37.999811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:38.000914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:38.001866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:38.261174 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:38.273248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c1d990d6-08bc-47ce-b0bc-92ef70a2e292 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.302146 Sep 07 13:37:38.274047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 321/631] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:37 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:38.388194 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c4eb68aa-3891-46dc-ac9e-28e3eb01f98c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 204 len: 0 microversion: 2.20 time: 0.526920 Sep 07 13:37:38.389003 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 311/632] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 7 13:37:37 2022] DELETE /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:37:38.400636 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:38.401510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:38.410288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:38.410857 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:38.411307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:38.412015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:38.412508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:38.413112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:38.527474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-952e488e-e1d2-49c0-9e8b-07caef73a8df req-5fe58313-6bbc-417b-855c-57dbed57a905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca16a96-0541-4390-a233-dc6c347b9c92", "name": "network-vif-plugged", "status": "completed", "tag": "f7b08ccd-34e6-445f-aa4f-cb4cf44fd1a8"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:38.563676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-952e488e-e1d2-49c0-9e8b-07caef73a8df req-5fe58313-6bbc-417b-855c-57dbed57a905 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:38.565921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-952e488e-e1d2-49c0-9e8b-07caef73a8df req-5fe58313-6bbc-417b-855c-57dbed57a905 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:38.567297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-952e488e-e1d2-49c0-9e8b-07caef73a8df req-5fe58313-6bbc-417b-855c-57dbed57a905 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:38.590070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-952e488e-e1d2-49c0-9e8b-07caef73a8df req-5fe58313-6bbc-417b-855c-57dbed57a905 service nova] Creating event network-vif-plugged:f7b08ccd-34e6-445f-aa4f-cb4cf44fd1a8 for instance 8ca16a96-0541-4390-a233-dc6c347b9c92 on hv-cinder-85625 Sep 07 13:37:38.601506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-952e488e-e1d2-49c0-9e8b-07caef73a8df req-5fe58313-6bbc-417b-855c-57dbed57a905 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085066 Sep 07 13:37:38.603124 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 312/633] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:38.684853 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:38.699685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:38.702947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:38.704664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bc8c514d-f6ac-43f9-abd2-09585a87dcd6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.308495 Sep 07 13:37:38.705739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 322/634] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:38 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:37:38.743594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-24b6f164-df3c-430c-8866-e0a6da6e0232 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: .version_select at 0x7f1747ce5700>, body: {"keypair": {"name": "tempest-keypair-854749684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUYdz+dQdwhC16Vs76kFFowVbMKR7LufSzebiLlZahuHVZVFdEzUNIyo2JZX73yofU8M+jgokLXSC5jWM+5Ya/MDE1Gh0XRA6THMedH7syQu+ri0THcvRSFSXefH+VzMQ=="}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:38.771508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-24b6f164-df3c-430c-8866-e0a6da6e0232 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:37:38.779900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-24b6f164-df3c-430c-8866-e0a6da6e0232 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:37:38.921714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-24b6f164-df3c-430c-8866-e0a6da6e0232 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186438 Sep 07 13:37:38.923110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 313/635] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:37:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:38.956254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:38.957599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:38.972668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:38.973703 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:38.974694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:38.975895 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:38.976727 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:38.977452 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:39.186282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:39.200687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-74fbb820-8ede-4e29-9792-b516ec0fbad1 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.253409 Sep 07 13:37:39.201484 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 323/636] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:38 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:39.310434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:39.311899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:39.325019 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:39.325888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:39.327301 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:39.328518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:39.329417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:39.330247 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:39.570584 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:39.582722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a82c46d7-418e-43bf-a233-5e7fc6f679bf tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.280969 Sep 07 13:37:39.583515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 314/637] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:39 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:39.759850 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:39.761056 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:39.770453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:39.771361 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:39.772008 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:39.773275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:39.773926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:39.774536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:39.998608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:40.016164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:40.018609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:40.020912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d531722b-e5c6-446f-a9a7-7426dc5f1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.266163 Sep 07 13:37:40.021700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 324/638] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:39 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:37:40.231271 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:40.233624 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:40.248235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:40.249982 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:40.251309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:40.253952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:40.255212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:40.256153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:40.614856 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:40.615562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:40.615802 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:40.624283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:40.624960 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:40.625947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:40.626889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:40.627516 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:40.628565 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:40.631609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7c45a006-1a5b-48aa-b9ce-88ee343801a7 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.410095 Sep 07 13:37:40.633131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 315/639] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:40 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:40.928644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:40.943378 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-35c79d95-1d73-4fb8-b740-f6fd9562d1b6 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.332791 Sep 07 13:37:40.944782 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 325/640] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:40 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:41.054621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:41.055482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:41.069603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:41.069603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:41.069603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:41.069603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:41.070259 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:41.070259 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:41.356292 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:41.385505 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:41.394692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:41.397567 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0d4fc50a-af72-44d4-97dd-3e2c6f4ea1e4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.348555 Sep 07 13:37:41.400517 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 316/641] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:41 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:37:41.670931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:41.672796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:41.685408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:41.686265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:41.687346 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:41.689238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:41.690604 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:41.691656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:41.984373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:41.986064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:41.999650 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:42.007225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:42.007225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:42.007225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:42.007225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:42.007666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:42.023586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:42.038385 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c0f72740-6205-4e03-a177-3089b8b0c20c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1319 microversion: 2.1 time: 0.374572 Sep 07 13:37:42.040492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 326/642] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:41 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:42.442771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:42.454175 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:42.454465 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d69ab8d4-b49d-4843-8640-afda1dae6f7e tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.486990 Sep 07 13:37:42.455429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 317/643] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:41 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:42.491026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:42.517439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:42.518873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:42.519740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:42.520968 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:42.521523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:42.522131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:42.841613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:42.867847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:42.881440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:42.888045 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ad7c4eeb-04cf-44fd-8eb5-eb2c720f9ec2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1725 microversion: 2.20 time: 0.444256 Sep 07 13:37:42.889794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 327/644] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:42 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1725 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:37:42.966216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1116922665", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834c0-0dea-41cd-83a3-dc66b7dd2f54"}], "security_groups": [{"name": "tempest-securitygroup--1941207262"}], "key_name": "tempest-keypair-854749684", "user_data": "}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:43.086184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:43.086967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:43.095540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:43.096093 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:43.096562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:43.106837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:43.106837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:43.106837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:43.363883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:43.379366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b66a2014-4e45-449b-ae30-3acbcf1b7423 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1509 microversion: 2.1 time: 0.300984 Sep 07 13:37:43.380437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 328/645] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:43 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:43.430013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca12d1fc-d3da-43fb-931a-297c32f1dc75", "device": "/dev/sdb"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:43.438414 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:43.457539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:43.460671 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:43.461508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:43.473793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:43.473793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:43.473793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:43.491403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] validate_networks() for [('6b6834c0-0dea-41cd-83a3-dc66b7dd2f54', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:37:44.337216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:37:44.337676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:37:44.338391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:37:44.338920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:37:44.339397 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:37:44.356183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:44.357072 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:44.357876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:44.359341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:44.360192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:44.360969 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:44.396075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:37:44.404619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:37:44.438579 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:37:44.445162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:37:44.647656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-58633ef5-4ef1-4a53-9c8d-8faf31603626 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.685870 Sep 07 13:37:44.661471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 318/646] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:37:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:37:44.671596 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:44.673202 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:44.684167 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:44.685400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:44.685606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:44.686550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:44.687356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:44.688135 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:44.805528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-77c76d8f-ccd7-4913-b3c6-6124e70338de tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "POST /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.382889 Sep 07 13:37:44.814750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 329/647] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:37:43 2022] POST /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92/os-volume_attachments => generated 194 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:44.874716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:44.890715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:44.929645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:44.943019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:44.947912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:44.948738 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:44.960914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:44.960914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:45.003312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:45.025678 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:45.066737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-86e032f8-5119-417d-b6ad-072d120440aa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1737 microversion: 2.1 time: 0.402809 Sep 07 13:37:45.068265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 319/648] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:44 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:45.091518 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-a3f5163e-e7d8-4847-8c7a-0e27c689a207 req-b771bbe0-4715-4ae1-b9c7-d2b34fd22750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d77c88-2507-41f1-a8bf-604880929568", "name": "network-vif-deleted", "tag": "dbb94b1d-c06e-4515-a9ea-b00bd9245f9d"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:45.125597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a3f5163e-e7d8-4847-8c7a-0e27c689a207 req-b771bbe0-4715-4ae1-b9c7-d2b34fd22750 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:45.126317 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a3f5163e-e7d8-4847-8c7a-0e27c689a207 req-b771bbe0-4715-4ae1-b9c7-d2b34fd22750 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:45.127063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a3f5163e-e7d8-4847-8c7a-0e27c689a207 req-b771bbe0-4715-4ae1-b9c7-d2b34fd22750 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:45.175633 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-a3f5163e-e7d8-4847-8c7a-0e27c689a207 req-b771bbe0-4715-4ae1-b9c7-d2b34fd22750 service nova] Creating event network-vif-deleted:dbb94b1d-c06e-4515-a9ea-b00bd9245f9d for instance 78d77c88-2507-41f1-a8bf-604880929568 on hv-cinder-85625 Sep 07 13:37:45.177873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:45.196072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:45.197213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-a3f5163e-e7d8-4847-8c7a-0e27c689a207 req-b771bbe0-4715-4ae1-b9c7-d2b34fd22750 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124051 Sep 07 13:37:45.198854 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:45.204996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2e24db7c-2e27-406e-836e-8ab10ebff58b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1657 microversion: 2.20 time: 0.353775 Sep 07 13:37:45.204996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 330/649] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:44 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1657 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:37:45.211783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 320/650] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:45.223001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b2006672-038b-48c3-8d0c-3dad5b86ebc0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:45.224122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b2006672-038b-48c3-8d0c-3dad5b86ebc0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:45.731262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b2006672-038b-48c3-8d0c-3dad5b86ebc0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:45.755337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b2006672-038b-48c3-8d0c-3dad5b86ebc0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1241 microversion: 2.1 time: 0.541845 Sep 07 13:37:45.755337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 331/651] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:45 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1241 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:46.259924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:46.261790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:46.281513 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.283022 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.285860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.288066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.289470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.289967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.344822 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.345545 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.346108 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.347985 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lazy-loading 'fault' on Instance uuid 78d77c88-2507-41f1-a8bf-604880929568 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:46.410568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:46.411939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:46.420087 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.420818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.421310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.422463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.423126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.423321 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:46.423562 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.438147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:46.442518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:46.445176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-31b1e644-a904-4572-a656-c515dc9508fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 200 len: 1371 microversion: 2.20 time: 0.189860 Sep 07 13:37:46.446522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 332/652] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:46 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:37:46.629604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:46.641143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5b872f4b-8661-4512-ba3d-3ed4f20d7fcb tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1717 microversion: 2.1 time: 0.518949 Sep 07 13:37:46.648012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 321/653] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:46 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1717 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:46.728720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:46.729226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:46.736303 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.737895 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.737895 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.738618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.739124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.739590 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.776494 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:46.777626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:46.783553 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:46.791943 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.792503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.793341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.794846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.796212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.796936 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.881744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] HTTP exception thrown: Cannot 'detach_volume' instance 42374ed7-b063-4892-b40a-da27fb0779ce while it is in vm_state rescued Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Request method failure captured: Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments/a8f2c7cf-8bb4-4ed7-9713-62ae92f74734 HTTP/1.1 Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ17TUxo6EfuBC0CdjNCEeEs91aGmysfruTnTQ9124bG-xdwpvpqCxrTPdNUpOLvDDax6OVm9GYvGDzJM5KNyyPoBv1JyDPCdwoa_eZjHVQmYMFZT8CedEiTEuXxeJvwaaOa-o0Gco-PYuO6-Gx86B8J-sf6yrpuZ9Zp3IrtUK8JwVY Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:37:46.883922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1070aeddb0d544f4b3b4c1e41979944d", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: a145e63a44db43acafc92bb2a238f463 Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:37:46.885238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Cannot 'detach_volume' instance 42374ed7-b063-4892-b40a-da27fb0779ce while it is in vm_state rescued Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'server_id': '42374ed7-b063-4892-b40a-da27fb0779ce', 'id': 'a8f2c7cf-8bb4-4ed7-9713-62ae92f74734'} Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 42374ed7-b063-4892-b40a-da27fb0779ce in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:37:46.886014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 42374ed7-b063-4892-b40a-da27fb0779ce while it is in vm_state rescued Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 42374ed7-b063-4892-b40a-da27fb0779ce while it is in vm_state rescued Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:46.887461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Returning 409 to user: Cannot 'detach_volume' instance 42374ed7-b063-4892-b40a-da27fb0779ce while it is in vm_state rescued {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:37:46.888607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c785b547-047f-4f63-80a6-8caf913cdf6f tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "DELETE /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments/a8f2c7cf-8bb4-4ed7-9713-62ae92f74734" status: 409 len: 152 microversion: 2.1 time: 0.162120 Sep 07 13:37:46.899286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 333/654] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:37:46 2022] DELETE /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments/a8f2c7cf-8bb4-4ed7-9713-62ae92f74734 => generated 152 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 13:37:46.910101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:46.910896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:46.918925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.919575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.920013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.921010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:46.921476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:46.921922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:46.942262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:46.953450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0a74123d-9972-4d9c-8f37-835aac02a128 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1245 microversion: 2.1 time: 0.185128 Sep 07 13:37:46.954618 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 322/655] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:46 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:47.259875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c20bd3d3-f0ed-4483-8b27-831b45beed6c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "POST /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/action" status: 202 len: 0 microversion: 2.1 time: 0.358417 Sep 07 13:37:47.261220 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 334/656] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:37:46 2022] POST /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:37:47.288715 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:47.290109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:47.304125 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:47.305165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:47.306005 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:47.307646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:47.308617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:47.309401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:47.340785 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:47.485336 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:47.491454 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:47.523536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:47.524547 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:47.525517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:47.527019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:47.528297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:47.529204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:47.568492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] HTTP exception thrown: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Request method failure captured: Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 HTTP/1.1 Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2YX19fcJdafG7qjP2JxDFMHv7AVVZgK0Xg9LwrDtukhvCPjDJ64Nb3c-qVhrNgA9UDSlLYR58CbU2kMyfFeOda984TCsfNLAdtIlgtHIfOzJKX81BI__JitCO3LKVRQOkUzyu1vP9E2zV2SSaExQBHFhL51nLFvmfsLyTNUE30s0w Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:37:47.576670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a627a9e151e4e8d8522afbc844c550c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 32401931d75649018f6b0e55144bb5f2 Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:37:47.579503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '78d77c88-2507-41f1-a8bf-604880929568'} Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:37:47.584183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:37:47.594260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:37:47.601242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Returning 404 to user: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:37:47.601242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-21fc6b80-e9a8-4fde-bac4-be5fc8cfebb0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 404 len: 111 microversion: 2.20 time: 0.110077 Sep 07 13:37:47.601242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 335/657] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:47 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:37:47.620116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c06d1892-5103-4033-a1ec-a797a85a1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '.version_select at 0x7f1747d48e50>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:47.729133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c06d1892-5103-4033-a1ec-a797a85a1cb5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927169514" status: 204 len: 0 microversion: 2.20 time: 0.126440 Sep 07 13:37:47.732640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 336/658] 10.222.0.62 () {60 vars in 1262 bytes} [Wed Sep 7 13:37:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927169514 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 13:37:47.755806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:47.767601 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a611bfd8-1509-4b33-96e7-55e4fb71bcb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1725 microversion: 2.1 time: 0.497106 Sep 07 13:37:47.769461 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 323/659] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:47 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1725 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:48.003584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:48.012828 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:48.026494 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:48.030581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:48.033406 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:48.034915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:48.038224 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:48.039052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:48.145982 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:48.160284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-83e6ad6b-4307-4ee0-b451-908411681404 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1293 microversion: 2.1 time: 0.183540 Sep 07 13:37:48.160627 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 337/660] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:47 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:48.811680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:48.813250 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:48.823824 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:48.824688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:48.825314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:48.826713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:48.827560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:48.830091 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:49.209638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:49.211880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:49.225751 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:49.227033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:49.228531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:49.230471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:49.231661 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:49.232662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:49.413490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:49.438135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3f931335-a858-4400-ac85-c35da2505920 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1299 microversion: 2.1 time: 0.238310 Sep 07 13:37:49.450223 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 338/661] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:49 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1299 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:49.601811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:49.622954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3a0b899d-aaff-4cb5-b4b1-75b67a527598 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'create', calling method: .version_select at 0x7f1747ecdca0>, body: {"keypair": {"name": "tempest-keypair-1785127292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRheaGUI24rbyoJG20YZQkwgXuuOJxRUEOaV77NOUNxXxE1NSuUWPqOU7nTc8D7D66UebiaKBH1BCm8kZKQbVbT/QpY/RsEknUryvyGWsdiQWDHDgvBJ5pwbFe5Q4vKNQ=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:49.625380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4871356c-4cb2-4f27-a8c0-08a09c0aa3fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1725 microversion: 2.1 time: 0.819047 Sep 07 13:37:49.625986 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 324/662] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:48 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1725 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:49.659967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3a0b899d-aaff-4cb5-b4b1-75b67a527598 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:37:49.667097 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3a0b899d-aaff-4cb5-b4b1-75b67a527598 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for user 32401931d75649018f6b0e55144bb5f2 and project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:37:49.847419 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3a0b899d-aaff-4cb5-b4b1-75b67a527598 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.233068 Sep 07 13:37:49.859088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 339/663] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Sep 7 13:37:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 07 13:37:50.475055 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:50.475773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:50.483339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:50.483910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:50.484596 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:50.485322 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:50.486617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:50.487495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:50.668618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:50.669298 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:50.682603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:50.683141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:50.685103 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:50.686027 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:50.686496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:50.686930 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:50.863742 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:50.895486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0226ff41-5958-4902-8556-545c5766f016 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.424852 Sep 07 13:37:50.898058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 325/664] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:50 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:51.611758 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:51.623161 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bfa1c544-ac6c-4139-a614-ef275f1fdb70 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1725 microversion: 2.1 time: 0.959656 Sep 07 13:37:51.645167 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 340/665] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:50 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1725 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:51.947744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:51.950497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:51.977303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:51.978154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:51.978767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:51.979741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:51.980432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:51.981023 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:52.367943 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:52.384448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3c9dd2d3-e713-459f-8a3d-8570c95e39a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.461415 Sep 07 13:37:52.385580 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 326/666] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:51 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:52.653884 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:52.656647 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:52.672307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:52.673992 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:52.677323 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:52.697388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:52.698870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:52.700426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:53.156626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:53.198851 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-29d063fc-7b43-4df4-a207-a6a7d467cab7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1731 microversion: 2.1 time: 0.552271 Sep 07 13:37:53.201072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 341/667] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:52 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1731 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:53.254641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:53.263305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:53.277383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:53.278131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:53.291642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:53.293254 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:53.294046 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:53.294907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:53.437750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:53.444436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:53.476748 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:53.478184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:53.479284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:53.480938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:53.482774 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:53.485043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:53.693128 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-228e9472-d66e-4db1-8999-2693fe9dff0b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.462085 Sep 07 13:37:53.694891 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 327/668] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:37:53 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-interface => generated 285 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:53.916856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-5af6f6ed-a76c-4dbe-ad21-46f52fbf5fac req-ec1da331-26cc-4b9d-9bf7-03d7065033ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162641ad-da96-482a-bfef-b82281e487b5", "tag": "bf6e47cf-3233-4efe-b5b8-921efc26ce5d"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:53.959238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-5af6f6ed-a76c-4dbe-ad21-46f52fbf5fac req-ec1da331-26cc-4b9d-9bf7-03d7065033ee service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:53.960051 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-5af6f6ed-a76c-4dbe-ad21-46f52fbf5fac req-ec1da331-26cc-4b9d-9bf7-03d7065033ee service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:53.960800 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-5af6f6ed-a76c-4dbe-ad21-46f52fbf5fac req-ec1da331-26cc-4b9d-9bf7-03d7065033ee service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:54.006366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-5af6f6ed-a76c-4dbe-ad21-46f52fbf5fac req-ec1da331-26cc-4b9d-9bf7-03d7065033ee service nova] Creating event network-changed:bf6e47cf-3233-4efe-b5b8-921efc26ce5d for instance 162641ad-da96-482a-bfef-b82281e487b5 on hv-cinder-85625 Sep 07 13:37:54.029882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-5af6f6ed-a76c-4dbe-ad21-46f52fbf5fac req-ec1da331-26cc-4b9d-9bf7-03d7065033ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112239 Sep 07 13:37:54.029882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 328/669] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:54.092434 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:54.128241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ec48d9e8-429c-4551-b3dc-30888121a7cb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.697519 Sep 07 13:37:54.145973 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 342/670] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:53 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:54.939182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:54.940958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=10 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:54.961835 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-640691728", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7ddc2a2-a118-4acc-9703-1fd5dd4dc095"}], "security_groups": [{"name": "tempest-securitygroup--885835735"}], "key_name": "tempest-keypair-1785127292", "user_data": "}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:55.170892 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:55.172638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:55.181360 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:55.188762 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:55.188762 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:55.188762 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:55.188762 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:55.189143 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:55.372702 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] validate_networks() for [('f7ddc2a2-a118-4acc-9703-1fd5dd4dc095', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:37:55.530755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:55.583494 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e95a29be-bab5-48e0-af4f-9e8664bd1e45 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.416192 Sep 07 13:37:55.588298 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 343/671] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:55 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:56.433455 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:37:56.435368 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:37:56.436598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:37:56.438855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:37:56.440697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:37:56.467654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:56.468852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:56.469896 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:56.472369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:56.474343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:56.478352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:56.520916 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:37:56.530826 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Getting quotas for user 32401931d75649018f6b0e55144bb5f2 and project 6a627a9e151e4e8d8522afbc844c550c. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:37:56.561203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:37:56.565760 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:37:56.628935 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:56.629788 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:56.650170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:56.651716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:56.653269 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:56.656124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:56.657718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:56.659374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:56.853842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4d4005a4-a89d-4052-9ed8-d507784f9700 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.914458 Sep 07 13:37:56.855552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 329/672] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Sep 7 13:37:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 13:37:56.867758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-af530c3f-c5ad-411b-88a4-163528e9add3 req-0f93a530-496c-4158-b422-c0a8f0812532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42374ed7-b063-4892-b40a-da27fb0779ce", "tag": "024e4e3d-bd89-4219-9aa9-4e5be7865def"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:56.898312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-af530c3f-c5ad-411b-88a4-163528e9add3 req-0f93a530-496c-4158-b422-c0a8f0812532 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:56.899262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-af530c3f-c5ad-411b-88a4-163528e9add3 req-0f93a530-496c-4158-b422-c0a8f0812532 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:56.901881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-af530c3f-c5ad-411b-88a4-163528e9add3 req-0f93a530-496c-4158-b422-c0a8f0812532 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:56.934157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-af530c3f-c5ad-411b-88a4-163528e9add3 req-0f93a530-496c-4158-b422-c0a8f0812532 service nova] Creating event network-changed:024e4e3d-bd89-4219-9aa9-4e5be7865def for instance 42374ed7-b063-4892-b40a-da27fb0779ce on hv-cinder-85625 Sep 07 13:37:56.943454 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-af530c3f-c5ad-411b-88a4-163528e9add3 req-0f93a530-496c-4158-b422-c0a8f0812532 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084693 Sep 07 13:37:56.954238 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:56.956146 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 330/673] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:56.964413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-eac7fc0d-7791-4542-ab9b-ce4d5223e5b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:56.969093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-eac7fc0d-7791-4542-ab9b-ce4d5223e5b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:56.992965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9b08a1c8-bf97-4a34-95c2-15253fd39edc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.367777 Sep 07 13:37:57.007658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 344/674] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:56 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:57.114410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-eac7fc0d-7791-4542-ab9b-ce4d5223e5b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:57.133619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-eac7fc0d-7791-4542-ab9b-ce4d5223e5b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:57.139047 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-eac7fc0d-7791-4542-ab9b-ce4d5223e5b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:57.140692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-eac7fc0d-7791-4542-ab9b-ce4d5223e5b8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1281 microversion: 2.20 time: 0.183008 Sep 07 13:37:57.142474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 331/675] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:56 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:37:58.042080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:58.042780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:58.052966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:58.053471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:58.053967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:58.054709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:58.057247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:58.057990 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:58.198488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7a0c97e1-143f-48c9-b79e-e87be23761e7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:58.207870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7a0c97e1-143f-48c9-b79e-e87be23761e7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:58.429788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7a0c97e1-143f-48c9-b79e-e87be23761e7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:58.466550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7a0c97e1-143f-48c9-b79e-e87be23761e7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:58.489762 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7a0c97e1-143f-48c9-b79e-e87be23761e7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:58.492446 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7a0c97e1-143f-48c9-b79e-e87be23761e7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1281 microversion: 2.20 time: 0.301060 Sep 07 13:37:58.497853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 332/676] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:58 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:37:58.995572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-e11746f7-b144-4399-a6bd-6aa21ce76323 req-ce0ca645-8dd5-43ac-be1c-a8ec0750a058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42374ed7-b063-4892-b40a-da27fb0779ce", "tag": "024e4e3d-bd89-4219-9aa9-4e5be7865def"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:59.017475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:59.037896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-62a8513e-2b12-4f06-8572-b98aca4f6a7a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.995429 Sep 07 13:37:59.039334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 345/677] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:58 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:59.054042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e11746f7-b144-4399-a6bd-6aa21ce76323 req-ce0ca645-8dd5-43ac-be1c-a8ec0750a058 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:59.054640 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e11746f7-b144-4399-a6bd-6aa21ce76323 req-ce0ca645-8dd5-43ac-be1c-a8ec0750a058 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:59.059284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e11746f7-b144-4399-a6bd-6aa21ce76323 req-ce0ca645-8dd5-43ac-be1c-a8ec0750a058 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:59.083699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-e11746f7-b144-4399-a6bd-6aa21ce76323 req-ce0ca645-8dd5-43ac-be1c-a8ec0750a058 service nova] Creating event network-changed:024e4e3d-bd89-4219-9aa9-4e5be7865def for instance 42374ed7-b063-4892-b40a-da27fb0779ce on hv-cinder-85625 Sep 07 13:37:59.091485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-e11746f7-b144-4399-a6bd-6aa21ce76323 req-ce0ca645-8dd5-43ac-be1c-a8ec0750a058 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100425 Sep 07 13:37:59.093066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 333/678] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:37:59.526177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:59.526177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:59.534599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:59.535860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:59.536607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:59.538380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:59.539981 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:59.541110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:59.672629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:59.679304 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=6 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:59.685540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:59.688035 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:59.689233 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-04b72fef-4b93-41de-9de1-74bce0111f10 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1277 microversion: 2.20 time: 0.169907 Sep 07 13:37:59.692485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 346/679] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:37:59 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:00.420621 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:00.422364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:00.436033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:00.437003 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:00.437576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:00.438680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:00.439276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:00.441098 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:00.694040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:00.697757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-43dc745f-7fd7-4077-b339-f9d136427418 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.620815 Sep 07 13:38:00.698924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 334/680] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:00 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:00.735247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:00.735867 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:00.743961 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:00.744427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:00.744909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:00.745669 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:00.746126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:00.746552 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:00.889091 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:00.900844 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:00.902566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:00.904584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f5d290e6-e231-4589-9a84-47df59c989d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1333 microversion: 2.20 time: 0.173462 Sep 07 13:38:00.905265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 347/681] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:00 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:38:01.728862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:01.731459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:01.789420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:01.790835 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:01.791879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:01.793332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:01.794342 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:01.795201 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:01.954430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:01.967664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:01.988776 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:01.990170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:01.991239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:01.992874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:01.994040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:01.994706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:02.017315 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:02.036167 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-63447c32-2041-40e4-9cff-3ab251c3330e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.316955 Sep 07 13:38:02.038033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 335/682] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:01 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:02.147306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:02.157258 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:02.159668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:02.161122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f15a4ccf-2a62-4e01-bde0-dba5f556ac98 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1333 microversion: 2.20 time: 0.228187 Sep 07 13:38:02.162034 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 348/683] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:01 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:03.073575 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:03.076337 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:03.109263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:03.117098 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:03.117098 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:03.118228 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:03.119363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:03.120658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:03.215018 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:03.217638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:03.246728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:03.247659 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:03.248496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:03.249854 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:03.256676 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:03.256676 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:03.302780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:03.415614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:03.431678 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-608fe215-d00d-4f6b-bf68-66baf61313b3 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.368608 Sep 07 13:38:03.433419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 336/684] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:03 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:03.460732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:03.472951 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:03.475554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:03.477314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-adf1cbe7-6046-440b-823e-a3c443ee928a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1333 microversion: 2.20 time: 0.289833 Sep 07 13:38:03.478423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 349/685] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:03 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1333 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:04.464657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:04.465802 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:04.486018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:04.488032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:04.488991 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:04.490063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:04.490781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:04.491373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:04.518476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:04.520966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:04.531307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:04.532233 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:04.532949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:04.535473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:04.536478 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:04.537252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:04.694670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:04.711924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:04.717138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:04.740032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c1d7aba4-a745-4c26-9e75-af9a9c118654 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1333 microversion: 2.20 time: 0.205699 Sep 07 13:38:04.740032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 350/686] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:04 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1333 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:05.225441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:05.242025 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e7dfe19c-8325-420a-a6da-c32648a12b61 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.785394 Sep 07 13:38:05.245959 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 337/687] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:04 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:05.780470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:05.786783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:05.816966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:05.820897 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:05.821619 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:05.822912 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:05.823787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:05.829501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:06.010236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:06.028044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:06.031450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:06.033657 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3fdcb0c7-49c4-4361-a9eb-d47a69645775 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1339 microversion: 2.20 time: 0.263872 Sep 07 13:38:06.034555 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 351/688] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:05 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:06.292414 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:06.303088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:06.333646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:06.335445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:06.343758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:06.343758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:06.343758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:06.343758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:06.503015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:06.639880 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:06.667286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ce1d1b16-47c9-40cb-a751-98d971cc658e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.384247 Sep 07 13:38:06.682947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 338/689] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:06 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:06.938685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-d329c096-f422-4f83-814f-1949ba2abfdc req-5dff9d00-88df-4532-bb01-97b2cbadc61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162641ad-da96-482a-bfef-b82281e487b5", "name": "network-vif-plugged", "status": "completed", "tag": "bf6e47cf-3233-4efe-b5b8-921efc26ce5d"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:06.984259 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-d329c096-f422-4f83-814f-1949ba2abfdc req-5dff9d00-88df-4532-bb01-97b2cbadc61d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:06.991858 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-d329c096-f422-4f83-814f-1949ba2abfdc req-5dff9d00-88df-4532-bb01-97b2cbadc61d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:06.994707 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-d329c096-f422-4f83-814f-1949ba2abfdc req-5dff9d00-88df-4532-bb01-97b2cbadc61d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.035347 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-d329c096-f422-4f83-814f-1949ba2abfdc req-5dff9d00-88df-4532-bb01-97b2cbadc61d service nova] Creating event network-vif-plugged:bf6e47cf-3233-4efe-b5b8-921efc26ce5d for instance 162641ad-da96-482a-bfef-b82281e487b5 on hv-cinder-85625 Sep 07 13:38:07.057703 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-d329c096-f422-4f83-814f-1949ba2abfdc req-5dff9d00-88df-4532-bb01-97b2cbadc61d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123185 Sep 07 13:38:07.062114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 352/690] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:07.067388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:07.068829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:07.107549 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:07.108372 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:07.110269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.111490 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:07.112272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:07.112818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.728111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:07.729362 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:07.741508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:07.752690 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:07.754144 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:07.755490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.761282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:07.762629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:07.763841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.826264 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:07.836373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:07.847588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:07.851635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fcc3a341-de99-499d-a9d1-9234f3e8e8e5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.791016 Sep 07 13:38:07.871892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 339/691] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:07 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:38:08.235225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:08.264789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b13f1d4b-96cd-4028-acb6-8716fa87c162 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.543573 Sep 07 13:38:08.265922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 353/692] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:07 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:08.353524 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:08.354159 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:08.363565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:08.365925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:08.367011 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:08.368099 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:08.368729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:08.369848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:08.468528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=10 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:08.610818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'services' on Instance uuid 8ca16a96-0541-4390-a233-dc6c347b9c92 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:08.939664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-db7356f5-b7a0-49b3-8980-2ae4ae38cf08 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92/os-volume_attachments/ca12d1fc-d3da-43fb-931a-297c32f1dc75" status: 202 len: 0 microversion: 2.1 time: 0.589946 Sep 07 13:38:08.941451 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 340/693] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:38:08 2022] DELETE /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92/os-volume_attachments/ca12d1fc-d3da-43fb-931a-297c32f1dc75 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:38:08.957746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:08.959160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:08.971179 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:08.971971 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:08.972418 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:08.973233 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:08.973866 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:08.975454 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:09.126350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3d7a85dd-ba68-409d-a5c3-9417ee533ccd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Action: 'create', calling method: .version_select at 0x7f1747d66280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1952784259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJrEPV3YVchDpZKdM0qDuzq87mE9vr63Hnmv6AFE7SW8ttzVkPDtx0v2fKW8BOLD037iytiQA1Rv58rA8docDZEcySJ4MGWiTa/ndl7QtuIPDsggI2QpIyEDFkq5yvsDw=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:09.176642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3d7a85dd-ba68-409d-a5c3-9417ee533ccd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:38:09.192812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3d7a85dd-ba68-409d-a5c3-9417ee533ccd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for user 9dae215cd92f46d18a3c1b7389c3af4b and project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:38:09.276696 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:09.303069 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:09.307712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:09.311328 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8fa4fcef-2681-4677-91a1-bd60b383a26d tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.362383 Sep 07 13:38:09.316853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 341/694] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:08 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:09.333804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-b99bfc12-3083-4390-92c0-02dcffb88bad req-8f71f112-2907-4a65-bb19-c7f94bb37b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561fdee7-7a8f-4e24-98f8-6023d163c251", "tag": "0d0f70c6-6951-4686-973c-47ad49591ba2"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:09.355402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3d7a85dd-ba68-409d-a5c3-9417ee533ccd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.525460 Sep 07 13:38:09.355402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 354/695] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:38:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:09.360945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:09.363084 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:09.366695 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-b99bfc12-3083-4390-92c0-02dcffb88bad req-8f71f112-2907-4a65-bb19-c7f94bb37b4d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:09.367219 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-b99bfc12-3083-4390-92c0-02dcffb88bad req-8f71f112-2907-4a65-bb19-c7f94bb37b4d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:09.367742 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-b99bfc12-3083-4390-92c0-02dcffb88bad req-8f71f112-2907-4a65-bb19-c7f94bb37b4d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:09.372466 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:09.373136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:09.373699 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:09.374711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:09.375367 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:09.375905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:09.384611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-b99bfc12-3083-4390-92c0-02dcffb88bad req-8f71f112-2907-4a65-bb19-c7f94bb37b4d service nova] Creating event network-changed:0d0f70c6-6951-4686-973c-47ad49591ba2 for instance 561fdee7-7a8f-4e24-98f8-6023d163c251 on hv-cinder-85625 Sep 07 13:38:09.393417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-b99bfc12-3083-4390-92c0-02dcffb88bad req-8f71f112-2907-4a65-bb19-c7f94bb37b4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077398 Sep 07 13:38:09.394029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 342/696] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:09.574209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:09.591451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8292bf7b-1cef-4132-9f6d-d8b2ede6642a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1367 microversion: 2.1 time: 0.235577 Sep 07 13:38:09.592957 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 355/697] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:09 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:10.346157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:10.348371 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.360120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.360973 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.362049 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.363389 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.364177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.364991 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.624590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:10.640787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:10.643218 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:10.644987 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.646952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:10.649473 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-57523af4-7a47-4807-b545-a0523703dadb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.311183 Sep 07 13:38:10.654002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 343/698] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:10 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:10.660859 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.662263 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.664745 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.666563 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.668068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.669062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:11.384954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:11.400911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-daeaebea-22e0-4080-bdcd-8ae24802c6a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1557 microversion: 2.1 time: 0.766478 Sep 07 13:38:11.402739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 356/699] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:10 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1557 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:11.430280 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:11.431647 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:11.443272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:11.444145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:11.444792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:11.446016 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:11.446883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:11.447671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:11.630393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c8a3b6b8-301f-4804-9bc4-18b5c61ced6a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200672 Sep 07 13:38:11.631599 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 344/700] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:38:11 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:38:11.711049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:11.713522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:11.727147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:11.728272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:11.729059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:11.730360 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:11.731403 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:11.732204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:12.184740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:12.194858 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:12.197954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:12.200080 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-aa250e3f-a814-4cdd-9f52-a289a061f27b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.497733 Sep 07 13:38:12.200930 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 357/701] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:11 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:12.495716 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:12.496596 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:12.506381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:12.507492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:12.508324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:12.509743 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:12.510559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:12.511364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:12.556681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:12.567204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Going to try to terminate instance {{(pid=151552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:38:13.155832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-39b915a3-4cf7-41bb-99c3-605838c8aa67 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 204 len: 0 microversion: 2.1 time: 0.666229 Sep 07 13:38:13.158797 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 345/702] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:38:12 2022] DELETE /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:38:13.172311 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:13.174583 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:13.188725 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.190280 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.191851 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.193420 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.194490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.195684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.525686 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:13.527969 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:13.543999 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.545638 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.546868 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.550430 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.551797 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.552735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.808229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:13.823149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8b79947a-979a-4393-8880-e62072fb1905 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1515 microversion: 2.1 time: 0.657951 Sep 07 13:38:13.828103 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 358/703] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:13 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1515 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:13.845817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:13.864338 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:13.868054 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:13.871164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-08362b1c-5dbf-4922-898c-ce07b78cecc9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.642774 Sep 07 13:38:13.872238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 346/704] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:13 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:38:14.067079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-8158f451-a206-496a-9fea-66c97d9431af req-95109717-66ec-4fe9-8a3b-fca2599c4567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162641ad-da96-482a-bfef-b82281e487b5", "tag": "bf6e47cf-3233-4efe-b5b8-921efc26ce5d"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:14.092033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8158f451-a206-496a-9fea-66c97d9431af req-95109717-66ec-4fe9-8a3b-fca2599c4567 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.093456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8158f451-a206-496a-9fea-66c97d9431af req-95109717-66ec-4fe9-8a3b-fca2599c4567 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.094243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8158f451-a206-496a-9fea-66c97d9431af req-95109717-66ec-4fe9-8a3b-fca2599c4567 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.121519 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-8158f451-a206-496a-9fea-66c97d9431af req-95109717-66ec-4fe9-8a3b-fca2599c4567 service nova] Creating event network-changed:bf6e47cf-3233-4efe-b5b8-921efc26ce5d for instance 162641ad-da96-482a-bfef-b82281e487b5 on hv-cinder-85625 Sep 07 13:38:14.133587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-8158f451-a206-496a-9fea-66c97d9431af req-95109717-66ec-4fe9-8a3b-fca2599c4567 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083796 Sep 07 13:38:14.134498 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 359/705] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:14.870130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:14.872130 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:14.885352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.888293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.888293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.888589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.889497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.893690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.910316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:14.911802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:14.920310 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.921220 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.921949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.922946 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.924987 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.926037 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:15.183453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:15.197675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a4f14433-af5a-4465-ac91-b974826b240c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1515 microversion: 2.1 time: 0.333109 Sep 07 13:38:15.199265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 347/706] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:14 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1515 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:15.400151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:15.411247 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:15.412924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:15.414564 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2a867987-dd27-49d9-921c-e84d4b9119cb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.509645 Sep 07 13:38:15.415986 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 360/707] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:14 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:38:16.242269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:16.243427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:16.262210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.266513 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.273540 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.275235 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.276348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.277509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.456626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:16.459958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:16.479575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.481194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.482563 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.485501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.489933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.490943 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.527944 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:16.539432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b761ef2b-c691-4069-8dee-70869bbe4529 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1515 microversion: 2.1 time: 0.304313 Sep 07 13:38:16.540110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 348/708] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:16 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:16.706076 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:16.725720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:16.728785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:16.730658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bd80595b-c6df-47f4-a8ac-b03810e90b2f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.279885 Sep 07 13:38:16.731646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 361/709] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:16 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:16.831204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-fbf5285b-3399-4060-8cb7-95695106b23f req-7e637060-a624-4056-9684-416395371558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca16a96-0541-4390-a233-dc6c347b9c92", "name": "network-vif-deleted", "tag": "f7b08ccd-34e6-445f-aa4f-cb4cf44fd1a8"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:16.842536 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-fbf5285b-3399-4060-8cb7-95695106b23f req-7e637060-a624-4056-9684-416395371558 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.843034 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-fbf5285b-3399-4060-8cb7-95695106b23f req-7e637060-a624-4056-9684-416395371558 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.843471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-fbf5285b-3399-4060-8cb7-95695106b23f req-7e637060-a624-4056-9684-416395371558 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.856152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-fbf5285b-3399-4060-8cb7-95695106b23f req-7e637060-a624-4056-9684-416395371558 service nova] Creating event network-vif-deleted:f7b08ccd-34e6-445f-aa4f-cb4cf44fd1a8 for instance 8ca16a96-0541-4390-a233-dc6c347b9c92 on hv-cinder-85625 Sep 07 13:38:16.862142 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-fbf5285b-3399-4060-8cb7-95695106b23f req-7e637060-a624-4056-9684-416395371558 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038702 Sep 07 13:38:16.862761 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 349/710] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:17.077386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-007d371b-e925-459c-9515-cbe70703ecdf req-c896c98f-857c-411d-b001-e650f52d450d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561fdee7-7a8f-4e24-98f8-6023d163c251", "name": "network-vif-plugged", "status": "completed", "tag": "0d0f70c6-6951-4686-973c-47ad49591ba2"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:17.096720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-007d371b-e925-459c-9515-cbe70703ecdf req-c896c98f-857c-411d-b001-e650f52d450d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:17.097581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-007d371b-e925-459c-9515-cbe70703ecdf req-c896c98f-857c-411d-b001-e650f52d450d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:17.098383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-007d371b-e925-459c-9515-cbe70703ecdf req-c896c98f-857c-411d-b001-e650f52d450d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:17.124860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-007d371b-e925-459c-9515-cbe70703ecdf req-c896c98f-857c-411d-b001-e650f52d450d service nova] Creating event network-vif-plugged:0d0f70c6-6951-4686-973c-47ad49591ba2 for instance 561fdee7-7a8f-4e24-98f8-6023d163c251 on hv-cinder-85625 Sep 07 13:38:17.134846 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-007d371b-e925-459c-9515-cbe70703ecdf req-c896c98f-857c-411d-b001-e650f52d450d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074496 Sep 07 13:38:17.136412 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 362/711] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:17.573708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:17.574492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:17.577048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:17.583434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:17.584858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:17.586086 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:17.587392 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:17.588178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:17.588757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:17.677221 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:17.679958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:17.681173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:17.682269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'fault' on Instance uuid 8ca16a96-0541-4390-a233-dc6c347b9c92 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:17.751265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:17.770252 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-42b6fb7d-f70f-405a-835f-a1fa5298714c tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1309 microversion: 2.1 time: 0.204349 Sep 07 13:38:17.771951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 350/712] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:17 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1309 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:17.792593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:17.793878 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:17.808686 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:17.809550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:17.811346 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:17.812592 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:17.813933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:17.815310 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.029272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:18.040725 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:18.043614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:18.045531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:18.048218 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:18.049982 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c50175ee-6a2b-41a7-ae5e-42c7bda4ea57 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.267530 Sep 07 13:38:18.055943 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 363/713] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:17 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:18.056151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.056151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.056151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.056151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.056648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.056648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.092428 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-35601826-8c12-4c1b-8450-9ce2b29ecf7f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057254 Sep 07 13:38:18.092934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 351/714] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:38:18 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:38:18.180176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:18.181208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:18.188765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.190000 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.190450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.191279 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.191765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.192200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.223423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:38:18.633371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-525be728-bac3-4b9e-a85f-a0c2a1d6e1e4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 204 len: 0 microversion: 2.1 time: 0.461650 Sep 07 13:38:18.634386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 364/715] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:38:18 2022] DELETE /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:38:18.646847 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:18.648024 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:18.656870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.657467 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.657914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.658743 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.659390 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.659849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.812880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:18.814383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:18.826504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.827421 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.828199 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.829528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.830389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.831306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.880281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:18.900285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-43ff9cb5-9cf9-4ab0-8b86-c94980a7b1cf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1671 microversion: 2.1 time: 0.259457 Sep 07 13:38:18.901918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 352/716] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:18 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1671 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:18.913940 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.914598 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.915400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.916363 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'fault' on Instance uuid 8ca16a96-0541-4390-a233-dc6c347b9c92 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:18.984300 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:18.997678 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-521f6e2e-7fb7-4e4f-a70c-54eb6c4aa0aa tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1309 microversion: 2.1 time: 0.192499 Sep 07 13:38:18.998442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 365/717] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:18 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:19.091225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:19.092066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:19.100316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.100881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.101374 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:19.102204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.102714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.103260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:19.264118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:19.281765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:19.284029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:19.286809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c28ae2c1-b89b-42d5-beaa-24b4a7f100f1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.199442 Sep 07 13:38:19.289112 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 353/718] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:19 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:19.938633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:19.940493 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:19.945317 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=4 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:19.955914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.965907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.965907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:19.965907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.965907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.966460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.026563 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:20.027882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:20.042357 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.043434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.044490 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.045812 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.046683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.047468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.094906 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.096001 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.096429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.096909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'fault' on Instance uuid 8ca16a96-0541-4390-a233-dc6c347b9c92 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:20.152416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:20.165927 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-66a69eb5-7c50-46c8-86b4-0126b4507928 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1309 microversion: 2.1 time: 0.144437 Sep 07 13:38:20.166937 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 354/719] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:20 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:20.194956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:20.208055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b41524cf-2ca5-4c9a-a564-5f682ebc592a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1671 microversion: 2.1 time: 0.277206 Sep 07 13:38:20.208728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 366/720] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:19 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1671 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:20.341058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:20.341773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:20.349380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.349930 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.350429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.351305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.351806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.352286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.517593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:20.534953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:20.536751 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:20.537950 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-056f673b-6c87-458f-a2c5-d8013569f15c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1406 microversion: 2.20 time: 0.201169 Sep 07 13:38:20.538796 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 355/721] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:20 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:21.195872 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:21.196888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:21.214943 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.215827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.216550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.217933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.218610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.219416 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.229463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:21.233928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:21.234719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:21.244070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.244581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.245038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.245849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.246354 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.247359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.292614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.293359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.294036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.294741 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lazy-loading 'fault' on Instance uuid 8ca16a96-0541-4390-a233-dc6c347b9c92 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:21.358102 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dcde357754a4f668c30c40dc838d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b6de13e7c64cbdb0f43bddfaebc4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:21.373884 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6d6b2882-034b-456f-bbc1-ad7f8dc32821 tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 200 len: 1309 microversion: 2.1 time: 0.184198 Sep 07 13:38:21.373884 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 367/722] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:21 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:21.433027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:21.442708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0b5a0eea-6299-4ba5-b26d-a48b6a10a455 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1671 microversion: 2.1 time: 0.213051 Sep 07 13:38:21.443479 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 356/723] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:21 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1671 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:21.566480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:21.567169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:21.574757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.575290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.575739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.576465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.576923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.577361 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.807273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:21.818325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:21.820179 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:21.821205 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bdbf57e9-cb1d-4671-bbc7-08f73525d803 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1598 microversion: 2.20 time: 0.260093 Sep 07 13:38:21.822088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 368/724] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:38:21 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1598 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:38:21.908176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:21.909079 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:21.918459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.919809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.920555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.921396 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.921881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.922846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.025241 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-01ecd231-34d8-47ed-b917-01892eb9e6a7 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122291 Sep 07 13:38:22.026105 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 357/725] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Sep 7 13:38:21 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:38:22.405656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:22.406295 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] [instance: 8ca16a96-0541-4390-a233-dc6c347b9c92] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:22.414681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.415334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.415854 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.416691 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.417249 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.417764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.434765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] HTTP exception thrown: Instance 8ca16a96-0541-4390-a233-dc6c347b9c92 could not be found. Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Request method failure captured: Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 HTTP/1.1 Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ33ORsrlEYoH8_r_P-KufUpFlClaIPhCgnVEcWu85lRapOeHMVbPgRl7DgP4celLkQ86bFaU_iefC_0x_3qqUc8f1kh3TPyKTKT3MpNbIOKakzOOoYLtdCnI7j4K2aGvHhUgUJRvyXHtGn8-m_PFDIJTyY4Ei3AvSdBm8ZoOBR-6Ug Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: e0b6de13e7c64cbdb0f43bddfaebc4ba Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesSnapshotTestJSON-9303285 Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:38:22.439062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0b6de13e7c64cbdb0f43bddfaebc4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0b6de13e7c64cbdb0f43bddfaebc4ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0b6de13e7c64cbdb0f43bddfaebc4ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0b6de13e7c64cbdb0f43bddfaebc4ba", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesSnapshotTestJSON-9303285 Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: e0b6de13e7c64cbdb0f43bddfaebc4ba Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-9303285 Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesSnapshotTestJSON-9303285-project Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 6dcde357754a4f668c30c40dc838d09f Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesSnapshotTestJSON-9303285-project Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 8ca16a96-0541-4390-a233-dc6c347b9c92 could not be found. Sep 07 13:38:22.441054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '8ca16a96-0541-4390-a233-dc6c347b9c92'} Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ca16a96-0541-4390-a233-dc6c347b9c92 could not be found. Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:38:22.441980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ca16a96-0541-4390-a233-dc6c347b9c92 could not be found. Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ca16a96-0541-4390-a233-dc6c347b9c92 could not be found. Sep 07 13:38:22.444950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:22.447169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] Returning 404 to user: Instance 8ca16a96-0541-4390-a233-dc6c347b9c92 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:38:22.447169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b1bec0db-938f-45a4-91cb-1669dc8cdc2d tempest-VolumesSnapshotTestJSON-9303285 tempest-VolumesSnapshotTestJSON-9303285-project] 10.222.0.62 "GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92" status: 404 len: 111 microversion: 2.1 time: 0.037275 Sep 07 13:38:22.447169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 369/726] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:22 2022] GET /compute/v2.1/servers/8ca16a96-0541-4390-a233-dc6c347b9c92 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:38:22.468796 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:22.469594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:22.489381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.491507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.493080 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.496527 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.497764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.498523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.845103 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:22.855817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-57244490-55d2-4c84-8144-feb3e0bd1d4b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1671 microversion: 2.1 time: 0.392031 Sep 07 13:38:22.856580 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 358/727] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:22 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1671 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:23.722554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-0f309022-be0f-437e-b285-be8d8dc0b2fb req-21a4d596-09ab-4ac9-94b8-20e9b1524b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd3d8fa7-7daf-4ceb-9906-985ba2fe332f", "name": "network-vif-deleted", "tag": "faac008a-f2a5-4e65-bbd0-203541bb181e"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:23.748232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-0f309022-be0f-437e-b285-be8d8dc0b2fb req-21a4d596-09ab-4ac9-94b8-20e9b1524b1d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:23.749996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-0f309022-be0f-437e-b285-be8d8dc0b2fb req-21a4d596-09ab-4ac9-94b8-20e9b1524b1d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:23.750908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-0f309022-be0f-437e-b285-be8d8dc0b2fb req-21a4d596-09ab-4ac9-94b8-20e9b1524b1d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:23.772478 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-0f309022-be0f-437e-b285-be8d8dc0b2fb req-21a4d596-09ab-4ac9-94b8-20e9b1524b1d service nova] Creating event network-vif-deleted:faac008a-f2a5-4e65-bbd0-203541bb181e for instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f on hv-cinder-85625 Sep 07 13:38:23.780025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-0f309022-be0f-437e-b285-be8d8dc0b2fb req-21a4d596-09ab-4ac9-94b8-20e9b1524b1d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065134 Sep 07 13:38:23.781343 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 370/728] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:23.900614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:23.903984 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:23.924916 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:23.925116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:23.925891 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:23.927463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:23.928350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:23.929376 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:24.094501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:24.112770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9e199ed4-82da-4918-a862-f925e857e550 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1604 microversion: 2.1 time: 0.229155 Sep 07 13:38:24.117413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 359/729] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:23 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1604 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:24.233488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-5597fbc0-2bbf-4d01-a0ef-34c4bba179b1 req-95d93cf3-e923-4c80-b78a-7754eb168f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561fdee7-7a8f-4e24-98f8-6023d163c251", "tag": "0d0f70c6-6951-4686-973c-47ad49591ba2"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:24.247975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5597fbc0-2bbf-4d01-a0ef-34c4bba179b1 req-95d93cf3-e923-4c80-b78a-7754eb168f6f service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:24.248857 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5597fbc0-2bbf-4d01-a0ef-34c4bba179b1 req-95d93cf3-e923-4c80-b78a-7754eb168f6f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:24.249604 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-5597fbc0-2bbf-4d01-a0ef-34c4bba179b1 req-95d93cf3-e923-4c80-b78a-7754eb168f6f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:24.263905 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-5597fbc0-2bbf-4d01-a0ef-34c4bba179b1 req-95d93cf3-e923-4c80-b78a-7754eb168f6f service nova] Creating event network-changed:0d0f70c6-6951-4686-973c-47ad49591ba2 for instance 561fdee7-7a8f-4e24-98f8-6023d163c251 on hv-cinder-85625 Sep 07 13:38:24.271749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-5597fbc0-2bbf-4d01-a0ef-34c4bba179b1 req-95d93cf3-e923-4c80-b78a-7754eb168f6f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042154 Sep 07 13:38:24.273216 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 371/730] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:25.154574 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:25.155471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:25.165666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:25.166598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:25.167357 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:25.168545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:25.169391 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:25.169826 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:25.220030 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:25.221444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:25.222446 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:25.223532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lazy-loading 'fault' on Instance uuid cd3d8fa7-7daf-4ceb-9906-985ba2fe332f {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:25.228053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:25.345846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:25.362874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ef552090-7db9-4676-9533-2b7822179dc6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 200 len: 1327 microversion: 2.1 time: 0.213774 Sep 07 13:38:25.381493 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 360/731] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:25 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 1327 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:26.405954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:26.406712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:26.413998 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:26.414482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:26.414924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:26.415657 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:26.416112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:26.416529 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:26.432684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] HTTP exception thrown: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Request method failure captured: Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f HTTP/1.1 Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2EXa52TDpYl8aAWcOGKhbuVDszmIstIdmAHZFLAVZFgSf-68tvlhjz8cTa3JlF4oaIEgeYyus64s27x8MfkyN3vBeBmgmYD8nbJVjAblQzdvQKr4-uY5DtOAmfi-UHt9mY5KbYfNqDvS0X6piTVFgHSIOixBVxs4K711mejMmQtSQ Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:38:26.434554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0e892aa9df049c387360b67c5e2e065", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 7e7db29f64934026abbe96d5cb5baf25 Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:38:26.439282 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': 'cd3d8fa7-7daf-4ceb-9906-985ba2fe332f'} Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:38:26.441265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:38:26.443924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:26.446546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Returning 404 to user: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:38:26.446546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0798d0d1-7453-4e3e-aec3-982f89b09416 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 404 len: 111 microversion: 2.1 time: 0.035064 Sep 07 13:38:26.446546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 372/732] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:26 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:38:26.448599 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-63f5dbb8-93df-4a51-b09e-e0668055db11 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '.version_select at 0x7f1747c5daf0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:26.537784 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-63f5dbb8-93df-4a51-b09e-e0668055db11 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-431850613" status: 202 len: 0 microversion: 2.1 time: 0.093746 Sep 07 13:38:26.538860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 361/733] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:38:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-431850613 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:38:27.765978 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c814073d-1738-4a68-81a4-e635bef51a6b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'create', calling method: .version_select at 0x7f1747d35940>, body: {"keypair": {"name": "tempest-keypair-550163045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE64+VRKMA8WfdctxCyguiyBtSliJLyCefg2WhUU1+aDgm/wLnRYY+aJsTKowQxTJ0Lkn/ntQI68ETceBmIS2c622kn5iM6EgLL33q4cyR06bCkPvMkb63Fe6t5fipJMA=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:27.787136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-c814073d-1738-4a68-81a4-e635bef51a6b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for project e0e892aa9df049c387360b67c5e2e065. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:38:27.792484 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-c814073d-1738-4a68-81a4-e635bef51a6b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for user 7e7db29f64934026abbe96d5cb5baf25 and project e0e892aa9df049c387360b67c5e2e065. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:38:27.910003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c814073d-1738-4a68-81a4-e635bef51a6b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148971 Sep 07 13:38:27.911003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 373/734] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:38:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:31.203441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-240216313", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10b9a5d0-4fa4-4810-92ba-bac4e37bdfcf"}], "security_groups": [{"name": "tempest-securitygroup--61195727"}], "key_name": "tempest-keypair-550163045", "user_data": "}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:31.334251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] validate_networks() for [('10b9a5d0-4fa4-4810-92ba-bac4e37bdfcf', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:38:31.942542 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:38:31.943332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:38:31.944183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:38:31.944456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:38:31.944925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:38:31.956357 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:31.956927 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:31.957416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:31.958236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:31.958757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:31.959281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:31.982688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for project e0e892aa9df049c387360b67c5e2e065. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:38:31.988730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Getting quotas for user 7e7db29f64934026abbe96d5cb5baf25 and project e0e892aa9df049c387360b67c5e2e065. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:38:32.004078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:38:32.006672 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:38:32.237293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-eb731a18-3e7a-482a-b17b-74259beae760 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.039554 Sep 07 13:38:32.238423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 362/735] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:38:31 2022] POST /compute/v2.1/servers => generated 400 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:38:32.251101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f9b777cd-25c3-4c06-84db-cb75a5fcfd9a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:32.252117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f9b777cd-25c3-4c06-84db-cb75a5fcfd9a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:32.330578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f9b777cd-25c3-4c06-84db-cb75a5fcfd9a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:32.340967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f9b777cd-25c3-4c06-84db-cb75a5fcfd9a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1236 microversion: 2.1 time: 0.094018 Sep 07 13:38:32.342050 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 374/736] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:32 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:33.387792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-76b4f39a-97b5-40aa-a3bb-25549a58a4ff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:33.388740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-76b4f39a-97b5-40aa-a3bb-25549a58a4ff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:33.467176 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-76b4f39a-97b5-40aa-a3bb-25549a58a4ff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:33.477025 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-76b4f39a-97b5-40aa-a3bb-25549a58a4ff tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1236 microversion: 2.1 time: 0.097837 Sep 07 13:38:33.478240 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 363/737] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:33 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:34.505662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:34.507115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:34.518859 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:34.519817 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:34.520569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:34.522037 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:34.522878 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:34.523683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:34.619692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:34.636064 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-be4429c4-fa4d-4782-a4ab-629e6dab6ff4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1232 microversion: 2.1 time: 0.135194 Sep 07 13:38:34.637109 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 375/738] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:34 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1232 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:34.706137 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:34.707095 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:34.720900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:34.721776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:34.722569 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:34.724294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:34.725138 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:34.725917 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:34.907017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'services' on Instance uuid 42374ed7-b063-4892-b40a-da27fb0779ce {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:35.233679 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-00dcda9f-0d51-41bd-8c95-757a1bcda055 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "DELETE /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments/a8f2c7cf-8bb4-4ed7-9713-62ae92f74734" status: 202 len: 0 microversion: 2.1 time: 0.537686 Sep 07 13:38:35.234891 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 364/739] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:38:34 2022] DELETE /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments/a8f2c7cf-8bb4-4ed7-9713-62ae92f74734 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:38:35.248474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:35.251666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:35.262928 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:35.263902 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:35.264784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:35.266194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:35.267244 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:35.268157 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:35.334655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-83e86727-18ad-45f6-a124-516defa92061 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091666 Sep 07 13:38:35.335032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 376/740] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:38:35 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:35.538909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1719465796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1952784259", "security_groups": [{"name": "tempest-secgroup-smoke-308951509"}], "block_device_mapping_v2": [{"uuid": "24cbff4d-a6b0-4eff-add4-ca6601a1f86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96dda948-6c1a-414d-b47c-330985b8eab3"}]}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:35.675436 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:35.677355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:35.690299 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:35.691183 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:35.691976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:35.693283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:35.694121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:35.695177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:35.696464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] validate_networks() for [('96dda948-6c1a-414d-b47c-330985b8eab3', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:38:35.803543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:35.813081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4fe0faee-bc14-4494-a38a-dbe678f61e86 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1296 microversion: 2.1 time: 0.142425 Sep 07 13:38:35.814046 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 377/741] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:35 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1296 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:36.289458 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:38:36.290175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:38:36.290641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:38:36.291111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:38:36.291740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:38:36.303633 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.304239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.304620 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.305528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.306148 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.306462 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.333926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:38:36.336251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for user 9dae215cd92f46d18a3c1b7389c3af4b and project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:38:36.350616 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:36.353904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:36.361630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.362276 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.363303 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.364693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.365496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.366094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.415177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8d066ae9-3920-4790-8c74-9679d0f3e5d7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068680 Sep 07 13:38:36.416044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 378/742] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:38:36 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:36.446840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:38:36.449786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24cbff4d-a6b0-4eff-add4-ca6601a1f86d',volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:38:36.846038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:36.846698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:36.854462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.854954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.855425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.856130 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.856579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.857021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:37.008186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:37.022562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-213b00de-e0cc-4022-8b10-f4eed6369cd3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1306 microversion: 2.1 time: 0.180505 Sep 07 13:38:37.023528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 379/743] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:36 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1306 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:37.436512 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:37.440008 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:37.450222 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:37.454626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:37.454626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:37.454626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:37.454626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:37.456402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:37.517984 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-36ad271e-a82f-4b74-be79-8c333d48757a tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087887 Sep 07 13:38:37.518629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 380/744] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:38:37 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:38:37.631972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:37.632755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:37.645153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:37.646340 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:37.647500 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:37.649296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:37.650535 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:37.651610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:37.672092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0dab51dd-7d53-4284-9166-db9f90e6433f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.148602 Sep 07 13:38:37.679838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 365/745] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:38:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:38:37.686134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-651f93f1-b3f2-4e93-9579-493dded4f9c3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:37.687140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-651f93f1-b3f2-4e93-9579-493dded4f9c3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:37.706452 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:38:37.752193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-651f93f1-b3f2-4e93-9579-493dded4f9c3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:37.762836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-651f93f1-b3f2-4e93-9579-493dded4f9c3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1095 microversion: 2.1 time: 0.080641 Sep 07 13:38:37.763950 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 366/746] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:37 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:38.048344 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:38.049341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:38.060228 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.061556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.062658 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.065399 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.070252 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.070252 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.200968 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4041b161-ae34-46d5-b129-73a488b0e7b8 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "DELETE /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 204 len: 0 microversion: 2.1 time: 0.575695 Sep 07 13:38:38.207512 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 381/747] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:38:37 2022] DELETE /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:38:38.219087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:38.221198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:38.232294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.233182 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.234381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.235778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.236934 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.238291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.293330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:38.305388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dedd513c-795c-4fd4-9df3-e27d9d410f74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.261831 Sep 07 13:38:38.306290 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 367/748] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:38 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:38.540563 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:38.555858 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c3b446fa-e1e1-49ad-993c-f7c6d028829b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1691 microversion: 2.1 time: 0.344816 Sep 07 13:38:38.557052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 382/749] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:38 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1691 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:38.790394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dbdd7758-b2c9-4b99-879c-b343eedcc5c1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:38.791190 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dbdd7758-b2c9-4b99-879c-b343eedcc5c1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:38.895107 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dbdd7758-b2c9-4b99-879c-b343eedcc5c1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:38.905459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dbdd7758-b2c9-4b99-879c-b343eedcc5c1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1095 microversion: 2.1 time: 0.119484 Sep 07 13:38:38.919012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 368/750] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:38 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1095 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:38.922817 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-effa632d-27e7-4b7f-b414-a9093bca2de8 req-a2e7f017-2237-4e86-ac64-0b6d1c5bb6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe2b587-f946-4e6f-886f-9d61136003f8", "tag": "93d79f52-dace-42c9-8bb3-b2f4a37d5daf"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:38.932039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:38.941909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-effa632d-27e7-4b7f-b414-a9093bca2de8 req-a2e7f017-2237-4e86-ac64-0b6d1c5bb6e3 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.942768 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-effa632d-27e7-4b7f-b414-a9093bca2de8 req-a2e7f017-2237-4e86-ac64-0b6d1c5bb6e3 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.943666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-effa632d-27e7-4b7f-b414-a9093bca2de8 req-a2e7f017-2237-4e86-ac64-0b6d1c5bb6e3 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.964127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-effa632d-27e7-4b7f-b414-a9093bca2de8 req-a2e7f017-2237-4e86-ac64-0b6d1c5bb6e3 service nova] Creating event network-changed:93d79f52-dace-42c9-8bb3-b2f4a37d5daf for instance 6fe2b587-f946-4e6f-886f-9d61136003f8 on hv-cinder-85625 Sep 07 13:38:38.973522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-effa632d-27e7-4b7f-b414-a9093bca2de8 req-a2e7f017-2237-4e86-ac64-0b6d1c5bb6e3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156275 Sep 07 13:38:38.978457 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 383/751] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:39.333768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:39.334506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:39.342582 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.343134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.343570 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.344365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.346342 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.346905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.511743 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:39.522263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-934243a8-2dc3-4fde-a646-2a53502d0517 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.193853 Sep 07 13:38:39.522866 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 369/752] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:39 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:39.590048 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:39.590764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:39.599452 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.602560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.602560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.602560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.602560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.603132 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.764480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:39.773596 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9bf51fdc-7527-44cc-8344-52ff7224d561 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1691 microversion: 2.1 time: 0.188139 Sep 07 13:38:39.774675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 384/753] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:39 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:39.932703 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:39.933436 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:39.941780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.942361 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.942847 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.943734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.944264 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.944741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:40.016952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:40.025751 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-af3dae79-3faa-4fcb-89d6-9f1db0987037 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1145 microversion: 2.1 time: 0.097335 Sep 07 13:38:40.026353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 370/754] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:39 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:40.550587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:40.551371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:40.564925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:40.565630 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:40.566242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:40.567358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:40.568085 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:40.568666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:40.758515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:40.768441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-787de699-3445-4284-8aa7-cb4c9bbac77b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.224387 Sep 07 13:38:40.769078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 385/755] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:40 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:40.816148 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:40.816853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:40.824727 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:40.825279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:40.825733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:40.826457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:40.826920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:40.827387 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.007780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:41.020557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-922ed0e4-ba5a-486e-b19f-0e6b1bae3631 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1691 microversion: 2.1 time: 0.209849 Sep 07 13:38:41.021299 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 371/756] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:40 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:41.051553 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:41.052246 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:41.059053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:41.059644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:41.060092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.060834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:41.061505 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:41.062170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.150167 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:41.160914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6cefe3bb-f38b-4847-aa12-37d21962b5f2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1145 microversion: 2.1 time: 0.114530 Sep 07 13:38:41.161996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 386/757] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:41 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:41.795180 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:41.795964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:41.803746 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:41.804246 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:41.804697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.805494 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:41.805897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:41.806330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.978567 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:41.990926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6a4e9625-8174-4cf9-82fc-14e9a0d5e9d0 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.199961 Sep 07 13:38:41.991740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 372/758] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:41 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:42.061502 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:42.062415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:42.072956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.073611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.074320 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.075402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.076463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.077365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.083353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:42.193242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:42.195087 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:42.208975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.210006 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.211033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.212274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.213036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.213680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.301475 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:42.308804 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:42.316245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-573b6924-662a-400a-a766-50d55d119aed tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1145 microversion: 2.1 time: 0.130237 Sep 07 13:38:42.317274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 373/759] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:42 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1145 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:42.335462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-21fffff5-55ea-4803-9f23-55fefaaf2b86 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1691 microversion: 2.1 time: 0.278088 Sep 07 13:38:42.336655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 387/760] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:42 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:43.021776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:43.022411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:43.029540 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.030098 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.030555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.031369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.032100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.032659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.201915 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:43.217054 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-37462126-4b9a-4a47-9c66-f72a5d038cad tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.199564 Sep 07 13:38:43.218132 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 374/761] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:43 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:43.347227 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:43.348450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:43.352236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=6 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:43.363683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.364561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.365474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.366580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.367592 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.368644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.374542 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:43.375194 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:43.386709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.386709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.386709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.386709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.387402 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.387402 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.476097 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:43.485877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-681eb9d7-5582-43bc-838e-1d13eb5dedb8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1145 microversion: 2.1 time: 0.145709 Sep 07 13:38:43.487757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 388/762] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:43 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1145 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:43.554561 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:43.564722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-32abd1d6-b4e8-4a60-898e-4c6b7e18a500 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1691 microversion: 2.1 time: 0.192767 Sep 07 13:38:43.565433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 375/763] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:43 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:44.251724 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:44.252898 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:44.266704 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.267580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.268364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.269883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.270733 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.271572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.510350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:44.513333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-07cec860-f5e4-4e89-b1d5-f9176b5d6707 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.266082 Sep 07 13:38:44.514241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 389/764] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:44 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:44.514450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:44.515206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:44.523251 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.523794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.524193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.524905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.525414 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.525918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.598619 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:44.599291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:44.600494 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:44.607089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.607777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.608387 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.609065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-af49f189-b88e-4957-b73a-6fdbe256d92d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1145 microversion: 2.1 time: 0.098830 Sep 07 13:38:44.609326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.609684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 376/765] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:44 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:44.611972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.612476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.883760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:44.908248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9a3fd6ae-a299-4f99-b7e0-889e126c1743 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1691 microversion: 2.1 time: 0.309388 Sep 07 13:38:44.910467 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 390/766] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:44 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1691 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:45.548712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:45.550724 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:45.560494 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:45.563410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.564792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.565705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:45.567402 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.568100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.576097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:45.646889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:45.648001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:45.658177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.659095 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.659800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:45.660800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.662007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.663052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:45.786261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:45.795847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f4a17fb7-ee10-4647-8f2b-be75a07a2d67 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1193 microversion: 2.1 time: 0.161626 Sep 07 13:38:45.797146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 391/767] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:45 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1193 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:45.817855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:45.834888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cd84c724-e35d-462e-acdd-7dc91fca8a2f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.297039 Sep 07 13:38:45.835677 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 377/768] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:45 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:45.941294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:45.942049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:45.952106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.952618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.953076 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:45.953900 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.954376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.954842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:46.027668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:46.040909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8e2881ba-61c5-406e-9f2e-1199685b3551 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1623 microversion: 2.1 time: 0.106353 Sep 07 13:38:46.042003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 392/769] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:45 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1623 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:46.319812 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=4 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:46.504924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-936b9709-f32f-4861-9e97-fbe5153d1e6b req-9c0ec071-d5ed-4549-82c5-d8e76141c95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42374ed7-b063-4892-b40a-da27fb0779ce", "name": "network-vif-deleted", "tag": "024e4e3d-bd89-4219-9aa9-4e5be7865def"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:46.525245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-936b9709-f32f-4861-9e97-fbe5153d1e6b req-9c0ec071-d5ed-4549-82c5-d8e76141c95f service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:46.525245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-936b9709-f32f-4861-9e97-fbe5153d1e6b req-9c0ec071-d5ed-4549-82c5-d8e76141c95f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:46.525245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-936b9709-f32f-4861-9e97-fbe5153d1e6b req-9c0ec071-d5ed-4549-82c5-d8e76141c95f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:46.531109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-936b9709-f32f-4861-9e97-fbe5153d1e6b req-9c0ec071-d5ed-4549-82c5-d8e76141c95f service nova] Creating event network-vif-deleted:024e4e3d-bd89-4219-9aa9-4e5be7865def for instance 42374ed7-b063-4892-b40a-da27fb0779ce on hv-cinder-85625 Sep 07 13:38:46.538134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-936b9709-f32f-4861-9e97-fbe5153d1e6b req-9c0ec071-d5ed-4549-82c5-d8e76141c95f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247744 Sep 07 13:38:46.538774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 378/770] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:38:46.837878 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:46.838687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:46.847525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:46.848196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:46.848766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:46.849670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:46.850311 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:46.851022 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:46.879719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:46.881036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:46.907889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:46.908918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:46.909817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:46.911201 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:46.914117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:46.914928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:46.956189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:46.966204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0054e2cf-d3f8-4ee1-a3f7-acdbe321531f tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1193 microversion: 2.1 time: 0.133043 Sep 07 13:38:46.967206 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 393/771] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:46 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1193 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:47.083885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:47.084983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:47.092666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:47.093240 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:47.093958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:47.095546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:47.096384 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:47.096884 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:47.138660 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:47.151657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9dd33d5f-6724-4ee5-a948-6443fbbf9959 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.278030 Sep 07 13:38:47.152616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 379/772] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:46 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:47.189907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:47.199947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c2630aa0-7fb8-4176-9893-60165f9ca35d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1623 microversion: 2.1 time: 0.122701 Sep 07 13:38:47.200446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 394/773] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:47 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1623 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:48.003933 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:48.004712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:48.014801 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.015340 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.016282 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.018203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.019108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.019532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.192448 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:48.193371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:48.201988 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.202617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.204846 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.206051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.206546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.207253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.220108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:48.263815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-10dfc6e1-0d10-4c3f-bf6a-52c21b16bc1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1201 microversion: 2.1 time: 0.266516 Sep 07 13:38:48.267102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 380/774] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:47 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1201 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:48.280483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:48.282732 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:48.295615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.298334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.300117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.301833 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.302926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.304277 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.408048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.410680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.412076 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.414066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'fault' on Instance uuid 42374ed7-b063-4892-b40a-da27fb0779ce {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:48.514140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:48.537965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-15ca0411-fd30-4c1b-ab62-a91489c30355 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 200 len: 1335 microversion: 2.1 time: 0.265835 Sep 07 13:38:48.539657 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 381/775] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:48 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 1335 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:48.794443 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:48.827683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-33544ca2-4412-40ac-9fb1-ccf7790672f8 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.627741 Sep 07 13:38:48.827683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 395/776] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:48 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:49.311043 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:49.312455 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:49.315551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=18 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:49.332594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.333477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.334153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:49.335144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.335755 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.336363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:49.341530 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:49.590482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:49.593218 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 42374ed7-b063-4892-b40a-da27fb0779ce] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:49.609462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.611212 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.612388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:49.613719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.614875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.615724 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:49.644456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] HTTP exception thrown: Instance 42374ed7-b063-4892-b40a-da27fb0779ce could not be found. Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Request method failure captured: Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce HTTP/1.1 Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ17TUxo6EfuBC0CdjNCEeEs91aGmysfruTnTQ9124bG-xdwpvpqCxrTPdNUpOLvDDax6OVm9GYvGDzJM5KNyyPoBv1JyDPCdwoa_eZjHVQmYMFZT8CedEiTEuXxeJvwaaOa-o0Gco-PYuO6-Gx86B8J-sf6yrpuZ9Zp3IrtUK8JwVY Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:38:49.648332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1070aeddb0d544f4b3b4c1e41979944d", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: a145e63a44db43acafc92bb2a238f463 Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 42374ed7-b063-4892-b40a-da27fb0779ce could not be found. Sep 07 13:38:49.651267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '42374ed7-b063-4892-b40a-da27fb0779ce'} Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42374ed7-b063-4892-b40a-da27fb0779ce could not be found. Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:38:49.652975 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42374ed7-b063-4892-b40a-da27fb0779ce could not be found. Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42374ed7-b063-4892-b40a-da27fb0779ce could not be found. Sep 07 13:38:49.655941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:38:49.659441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Returning 404 to user: Instance 42374ed7-b063-4892-b40a-da27fb0779ce could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:38:49.661263 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-609e6b97-b816-48c1-8e2a-204c03c5afb9 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce" status: 404 len: 111 microversion: 2.1 time: 0.078272 Sep 07 13:38:49.663133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 396/777] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:49 2022] GET /compute/v2.1/servers/42374ed7-b063-4892-b40a-da27fb0779ce => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:38:49.677425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-819f3e1c-b062-479d-9336-02c85172e9a7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '.version_select at 0x7f1747cde430>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:49.694165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:49.712350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-01c2b66f-8399-48e9-a881-03f363c84e17 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1278 microversion: 2.1 time: 0.398962 Sep 07 13:38:49.712350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 382/778] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:49 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1278 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:49.822694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-819f3e1c-b062-479d-9336-02c85172e9a7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-456826461" status: 202 len: 0 microversion: 2.1 time: 0.153074 Sep 07 13:38:49.829758 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 397/779] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:38:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-456826461 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:38:49.856554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:49.857682 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:49.872497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.873107 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.873558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:49.874335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.875242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.877018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:50.274237 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:50.292922 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-113cf234-64ba-43d8-a83a-af0907f6e0da tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.441750 Sep 07 13:38:50.305264 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 383/780] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:49 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:50.751842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:50.753291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:50.778206 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:50.779374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:50.780375 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:50.785107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:50.786473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:50.788742 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.054228 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:51.069954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8996f0fe-b39c-4543-a21a-b8c5f3ad98f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1278 microversion: 2.1 time: 0.327874 Sep 07 13:38:51.071814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 398/781] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:50 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:51.112184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-021de1c3-f40a-450c-a446-834650b9ac07 req-9abba5f3-8729-4ecd-a42f-70f399032d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe2b587-f946-4e6f-886f-9d61136003f8", "name": "network-vif-plugged", "status": "completed", "tag": "93d79f52-dace-42c9-8bb3-b2f4a37d5daf"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:51.140030 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-021de1c3-f40a-450c-a446-834650b9ac07 req-9abba5f3-8729-4ecd-a42f-70f399032d5b service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:51.141544 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-021de1c3-f40a-450c-a446-834650b9ac07 req-9abba5f3-8729-4ecd-a42f-70f399032d5b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:51.143826 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-021de1c3-f40a-450c-a446-834650b9ac07 req-9abba5f3-8729-4ecd-a42f-70f399032d5b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.167730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-021de1c3-f40a-450c-a446-834650b9ac07 req-9abba5f3-8729-4ecd-a42f-70f399032d5b service nova] Creating event network-vif-plugged:93d79f52-dace-42c9-8bb3-b2f4a37d5daf for instance 6fe2b587-f946-4e6f-886f-9d61136003f8 on hv-cinder-85625 Sep 07 13:38:51.183285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-021de1c3-f40a-450c-a446-834650b9ac07 req-9abba5f3-8729-4ecd-a42f-70f399032d5b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266917 Sep 07 13:38:51.185119 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 384/782] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:51.263529 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-e900eb2b-0063-4c15-acb7-4bb63cceac05 req-416dc115-cebb-407c-bb1d-aca523d874fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628c7746-90a9-47ed-a112-e91e1a62c0aa", "tag": "9f3289a6-1346-46ed-b353-ce1bdee8b13f"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:51.295959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-e900eb2b-0063-4c15-acb7-4bb63cceac05 req-416dc115-cebb-407c-bb1d-aca523d874fd service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:51.298607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-e900eb2b-0063-4c15-acb7-4bb63cceac05 req-416dc115-cebb-407c-bb1d-aca523d874fd service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:51.300087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-e900eb2b-0063-4c15-acb7-4bb63cceac05 req-416dc115-cebb-407c-bb1d-aca523d874fd service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.326599 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:51.330438 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:51.333808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-e900eb2b-0063-4c15-acb7-4bb63cceac05 req-416dc115-cebb-407c-bb1d-aca523d874fd service nova] Creating event network-changed:9f3289a6-1346-46ed-b353-ce1bdee8b13f for instance 628c7746-90a9-47ed-a112-e91e1a62c0aa on hv-cinder-85625 Sep 07 13:38:51.348554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-e900eb2b-0063-4c15-acb7-4bb63cceac05 req-416dc115-cebb-407c-bb1d-aca523d874fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091492 Sep 07 13:38:51.354629 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:51.355039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 399/783] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:38:51.357775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:51.357775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.358312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:51.360079 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:51.362039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.670401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:51.678181 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4f6698b6-ea46-494e-97d9-06cc27f9f4c3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.362136 Sep 07 13:38:51.679186 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 385/784] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:51 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:52.107518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:52.108605 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:52.118776 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:52.119572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:52.133696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:52.133696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:52.133696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:52.133696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:52.321561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:52.335789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-44427761-c9e4-4948-ba6d-560d34f3ead0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.237035 Sep 07 13:38:52.336849 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 400/785] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:52 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:52.721031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:52.721675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:52.731486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:52.732173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:52.732683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:52.733775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:52.734285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:52.735218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:52.954208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:52.964400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-675b9c37-059e-4598-ac9a-4ab40403e668 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.249385 Sep 07 13:38:52.965122 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 386/786] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:52 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:53.370089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:53.371054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:53.379610 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:53.380165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:53.381364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:53.382154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:53.382740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:53.383251 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:53.574173 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:53.585280 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2080b216-6164-4a33-b140-20881e8519f4 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.219183 Sep 07 13:38:53.587011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 401/787] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:53 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:53.994769 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:53.997874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:54.013523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.016303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.019464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.021639 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.022911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.024052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.283519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:54.293964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5429d151-e539-4017-9f69-abc8c11f85bc tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1360 microversion: 2.1 time: 0.307061 Sep 07 13:38:54.295024 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 387/788] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:53 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1360 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:54.360745 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:54.370465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:54.372894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.373775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.374583 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.376439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.377288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.378216 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.415992 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:38:54.629013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:54.630359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:54.642615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.643556 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.644568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.645788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.646768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.647362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.842155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8a8da211-bf30-4511-9241-0c72a34848a4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 204 len: 0 microversion: 2.1 time: 0.490032 Sep 07 13:38:54.842959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 402/789] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:38:54 2022] DELETE /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:38:54.857503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:54.858632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:54.871345 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.872127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.872971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.874366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.876068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.876831 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:55.077172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:55.092371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-63c2a3ac-352e-465b-9dbd-40050d862493 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1507 microversion: 2.1 time: 0.240748 Sep 07 13:38:55.093257 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 403/790] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:54 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:55.210520 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:55.234232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-446a95b0-1aaa-4832-a93f-d366584bc0fa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.598761 Sep 07 13:38:55.234232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 388/791] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:54 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:55.334727 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:55.347793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:55.347793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:55.347793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:55.347793 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:55.348486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:55.348486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:55.348486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:55.367278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:55.533895 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:55.548719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-61a8452f-8ffb-427f-90e1-121ba70cb427 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1546 microversion: 2.1 time: 0.217705 Sep 07 13:38:55.549797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 404/792] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:55 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:55.589448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:55.589993 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:55.598505 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:55.599320 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:55.599796 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:55.600660 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:55.601123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:55.601558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:55.705508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7698bcbf-4240-4dea-bbb4-f6a55ce16c92 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119747 Sep 07 13:38:55.706020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 389/793] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:38:55 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:38:56.137208 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:56.138361 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:56.151501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:56.152393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:56.153248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:56.154470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:56.155383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:56.156133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:56.249931 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:56.252175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:56.264634 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:56.266830 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:56.268654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:56.270811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:56.272027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:56.273104 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:56.544655 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:56.562207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-48418862-6cdd-412d-a87a-d410569c5516 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.320221 Sep 07 13:38:56.570088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 390/794] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:56 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:56.620603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:56.638522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3b882b8f-611b-423a-86f6-7666f45bb518 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1507 microversion: 2.1 time: 0.508931 Sep 07 13:38:56.639632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 405/795] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:56 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:57.497642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-053bc6be-0b31-46c4-b307-7cfad4aa5c72 req-eb837a9f-7067-4b52-8db1-9b9501b74d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2ca409-5b36-4b33-8293-98ab05050fb8", "name": "network-vif-deleted", "tag": "0af9b480-ae6f-4d62-960c-85881021091d"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:57.517731 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-053bc6be-0b31-46c4-b307-7cfad4aa5c72 req-eb837a9f-7067-4b52-8db1-9b9501b74d95 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:57.519036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-053bc6be-0b31-46c4-b307-7cfad4aa5c72 req-eb837a9f-7067-4b52-8db1-9b9501b74d95 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:57.520040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-053bc6be-0b31-46c4-b307-7cfad4aa5c72 req-eb837a9f-7067-4b52-8db1-9b9501b74d95 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:57.540230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-053bc6be-0b31-46c4-b307-7cfad4aa5c72 req-eb837a9f-7067-4b52-8db1-9b9501b74d95 service nova] Creating event network-vif-deleted:0af9b480-ae6f-4d62-960c-85881021091d for instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 on hv-cinder-85625 Sep 07 13:38:57.551200 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-053bc6be-0b31-46c4-b307-7cfad4aa5c72 req-eb837a9f-7067-4b52-8db1-9b9501b74d95 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062320 Sep 07 13:38:57.551911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 391/796] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:57.615182 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:57.615917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:57.636971 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-dbfbc886-b303-49bd-90e9-32b1d0dc9f3c req-4c8d9bb1-4a8c-4e95-a2b3-bde4f584d3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe2b587-f946-4e6f-886f-9d61136003f8", "tag": "93d79f52-dace-42c9-8bb3-b2f4a37d5daf"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:57.643899 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:57.644729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:57.645112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:57.646058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:57.646574 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:57.647072 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:57.651951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-dbfbc886-b303-49bd-90e9-32b1d0dc9f3c req-4c8d9bb1-4a8c-4e95-a2b3-bde4f584d3c6 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:57.652525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-dbfbc886-b303-49bd-90e9-32b1d0dc9f3c req-4c8d9bb1-4a8c-4e95-a2b3-bde4f584d3c6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:57.652970 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-dbfbc886-b303-49bd-90e9-32b1d0dc9f3c req-4c8d9bb1-4a8c-4e95-a2b3-bde4f584d3c6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:57.676937 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-dbfbc886-b303-49bd-90e9-32b1d0dc9f3c req-4c8d9bb1-4a8c-4e95-a2b3-bde4f584d3c6 service nova] Creating event network-changed:93d79f52-dace-42c9-8bb3-b2f4a37d5daf for instance 6fe2b587-f946-4e6f-886f-9d61136003f8 on hv-cinder-85625 Sep 07 13:38:57.684537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-dbfbc886-b303-49bd-90e9-32b1d0dc9f3c req-4c8d9bb1-4a8c-4e95-a2b3-bde4f584d3c6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054052 Sep 07 13:38:57.685834 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 392/797] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:38:57.693486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:57.694337 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:57.702348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:57.702956 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:57.704448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:57.705514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:57.706004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:57.706547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:57.834793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:57.862925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:57.866108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8705d02a-ae6e-4407-82b1-e970d09f789d tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1465 microversion: 2.1 time: 0.177920 Sep 07 13:38:57.869461 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 393/798] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:57 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:57.895962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-25b64d2f-2e76-40a4-b5ed-cedb9af1e0b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.293919 Sep 07 13:38:57.911359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 406/799] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:57 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:58.915175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:58.917613 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:58.930155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:58.931081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:58.936432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:58.943332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:58.943332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:58.943332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:58.943332 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:58.945257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:58.953872 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:58.955314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:58.955939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:58.956706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:58.957184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:58.957616 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:59.009832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:59.010721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:59.011643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:59.012473 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'fault' on Instance uuid 9a2ca409-5b36-4b33-8293-98ab05050fb8 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:38:59.100457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:59.115298 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6bdf1397-932f-4b10-90e5-121f77e82522 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 200 len: 1311 microversion: 2.1 time: 0.224506 Sep 07 13:38:59.120666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 394/800] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:58 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:59.246781 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:59.258871 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-eb4b7250-8699-4471-949d-41c9c3c8074e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.333289 Sep 07 13:38:59.260536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 407/801] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:58 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:00.153429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:00.154135 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 9a2ca409-5b36-4b33-8293-98ab05050fb8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:00.163623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.164258 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.164735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.165674 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.166184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.166798 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.184053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] HTTP exception thrown: Instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 could not be found. Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Request method failure captured: Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 HTTP/1.1 Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ17TUxo6EfuBC0CdjNCEeEs91aGmysfruTnTQ9124bG-xdwpvpqCxrTPdNUpOLvDDax6OVm9GYvGDzJM5KNyyPoBv1JyDPCdwoa_eZjHVQmYMFZT8CedEiTEuXxeJvwaaOa-o0Gco-PYuO6-Gx86B8J-sf6yrpuZ9Zp3IrtUK8JwVY Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:39:00.188336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1070aeddb0d544f4b3b4c1e41979944d", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: a145e63a44db43acafc92bb2a238f463 Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 could not be found. Sep 07 13:39:00.191093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '9a2ca409-5b36-4b33-8293-98ab05050fb8'} Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 could not be found. Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:39:00.192476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 could not be found. Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 could not be found. Sep 07 13:39:00.194314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:00.196581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Returning 404 to user: Instance 9a2ca409-5b36-4b33-8293-98ab05050fb8 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:39:00.196581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fb346039-c54f-492c-b6a6-012f9c74a452 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8" status: 404 len: 111 microversion: 2.1 time: 0.041676 Sep 07 13:39:00.196581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 395/802] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:00 2022] GET /compute/v2.1/servers/9a2ca409-5b36-4b33-8293-98ab05050fb8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:39:00.202211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:00.204101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:00.210946 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.211470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.211910 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.212633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.213090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.213515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.241813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:39:00.299444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:00.299444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:00.301295 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.301917 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.302603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.303619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.304126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.304592 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.488852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:00.497767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-874addb5-4e97-4cf4-817f-33d7824e8e1c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.208005 Sep 07 13:39:00.509343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 396/803] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:00 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:00.601840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-328b486a-92db-4257-92a8-48f344b893fa tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "DELETE /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 204 len: 0 microversion: 2.1 time: 0.403484 Sep 07 13:39:00.602354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 408/804] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:39:00 2022] DELETE /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:39:00.611758 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:00.612374 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:00.619615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.620154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.620492 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.621984 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:00.622730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:00.623211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:00.824525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:00.833812 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5a23b1ad-b3cf-4773-a0ed-5e3a91e18fb7 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.226881 Sep 07 13:39:00.834692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 397/805] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:00 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:01.506090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:01.506881 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:01.514479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:01.514998 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:01.515803 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:01.516414 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:01.516886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:01.517324 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:01.523858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:01.524774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:01.534488 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:01.535276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:01.535741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:01.536826 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:01.537965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:01.538732 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:01.552007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1be6f931-146d-4c09-bd09-43961fc3cf28 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/ips" status: 200 len: 149 microversion: 2.1 time: 0.051775 Sep 07 13:39:01.552609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 409/806] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:39:01 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:01.717352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:01.731590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5117111e-a316-417d-90e9-bbfa8ec07570 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.214103 Sep 07 13:39:01.732616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 398/807] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:01 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:01.860532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:01.864270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:01.868016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:01.868495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:01.868919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:01.869646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:01.870399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:01.870609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:02.043577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:02.055066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-58cc0591-1496-4eb7-b00a-dd28fbc216be tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.198901 Sep 07 13:39:02.056114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 410/808] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:01 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:02.773109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:02.773936 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:02.781236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:02.781778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:02.782213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:02.782941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:02.783431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:02.783971 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:02.962958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:02.972052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0780b807-fc03-4813-90da-dfe492e51fa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.203149 Sep 07 13:39:02.972670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 399/809] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:02 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:03.082688 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:03.083329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:03.092147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:03.092661 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:03.093139 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:03.094002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:03.095140 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:03.095140 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:03.279842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:03.290455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8373c264-1b27-4ac3-ae7d-98fc6b48aa7c tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1522 microversion: 2.1 time: 0.212333 Sep 07 13:39:03.291085 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 411/810] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:03 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:03.380199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f817876-3083-47e9-b1ce-f1f3457d73ca"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:03.383092 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:03.389722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:03.391631 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:03.392243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:03.393172 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:03.393664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:03.394110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:03.728439 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:03.998015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:03.999192 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:04.006821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:04.007465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:04.007889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:04.008624 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:04.009099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:04.009531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:04.197572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:04.208984 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-49c93ddf-53d4-4b08-bb02-641fa4d63fd6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.215816 Sep 07 13:39:04.209664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 412/811] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:03 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:04.316407 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:04.317026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:04.323979 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:04.324727 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:04.325021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:04.325749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:04.326212 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:04.326643 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:04.447549 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:04.463248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a17a6b47-3289-447f-aa9d-b73c419084ca tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1480 microversion: 2.1 time: 0.151204 Sep 07 13:39:04.464195 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 413/812] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:04 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1480 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:04.487280 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-4953125d-cb7c-4fa5-8443-0caad00be7db req-4175f490-319c-4050-8f01-e2cbfbd6ceb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f676c6-6bfd-4c01-b135-da2507403d9d", "name": "network-vif-deleted", "tag": "e3d0ab43-222f-471f-a4a5-9a1851be22ba"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:04.498962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4953125d-cb7c-4fa5-8443-0caad00be7db req-4175f490-319c-4050-8f01-e2cbfbd6ceb6 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:04.499634 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4953125d-cb7c-4fa5-8443-0caad00be7db req-4175f490-319c-4050-8f01-e2cbfbd6ceb6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:04.500744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4953125d-cb7c-4fa5-8443-0caad00be7db req-4175f490-319c-4050-8f01-e2cbfbd6ceb6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:04.522732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-4953125d-cb7c-4fa5-8443-0caad00be7db req-4175f490-319c-4050-8f01-e2cbfbd6ceb6 service nova] Creating event network-vif-deleted:e3d0ab43-222f-471f-a4a5-9a1851be22ba for instance 72f676c6-6bfd-4c01-b135-da2507403d9d on hv-cinder-85625 Sep 07 13:39:04.532284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-4953125d-cb7c-4fa5-8443-0caad00be7db req-4175f490-319c-4050-8f01-e2cbfbd6ceb6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050589 Sep 07 13:39:04.533990 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 414/813] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:04.545404 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-98249773-b397-4c59-a443-52dbb39fac2a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.168685 Sep 07 13:39:04.546585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 400/814] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:39:03 2022] POST /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments => generated 194 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:04.947852 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-b27e3a8d-ab23-434d-9936-4437bbb5e801 req-e0fd5023-c45b-41e8-bd31-051dc4fa726d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628c7746-90a9-47ed-a112-e91e1a62c0aa", "name": "network-vif-plugged", "status": "completed", "tag": "9f3289a6-1346-46ed-b353-ce1bdee8b13f"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:04.968777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-b27e3a8d-ab23-434d-9936-4437bbb5e801 req-e0fd5023-c45b-41e8-bd31-051dc4fa726d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:04.969658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-b27e3a8d-ab23-434d-9936-4437bbb5e801 req-e0fd5023-c45b-41e8-bd31-051dc4fa726d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:04.970475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-b27e3a8d-ab23-434d-9936-4437bbb5e801 req-e0fd5023-c45b-41e8-bd31-051dc4fa726d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:04.986755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-b27e3a8d-ab23-434d-9936-4437bbb5e801 req-e0fd5023-c45b-41e8-bd31-051dc4fa726d service nova] Creating event network-vif-plugged:9f3289a6-1346-46ed-b353-ce1bdee8b13f for instance 628c7746-90a9-47ed-a112-e91e1a62c0aa on hv-cinder-85625 Sep 07 13:39:04.992813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-b27e3a8d-ab23-434d-9936-4437bbb5e801 req-e0fd5023-c45b-41e8-bd31-051dc4fa726d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055292 Sep 07 13:39:04.993959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 415/815] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:05.253930 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:05.255855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:05.268038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:05.269019 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:05.269891 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:05.271334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:05.272205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:05.273100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:05.497765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:05.498542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:05.498863 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:05.506444 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:05.506860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:05.507487 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:05.508237 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:05.508709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:05.509321 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:05.515183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-500be0a4-be6d-4277-80c5-0adf3b1ee4ee tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.270247 Sep 07 13:39:05.516950 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 401/816] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:05 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:05.551730 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:05.552231 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:05.552693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:05.553151 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'fault' on Instance uuid 72f676c6-6bfd-4c01-b135-da2507403d9d {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:39:05.615572 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:05.630835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-812a175c-ec2d-41ee-8e3f-747d51fb85d4 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1312 microversion: 2.1 time: 0.143042 Sep 07 13:39:05.631779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 416/817] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:05 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:06.554416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:06.555183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:06.563237 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:06.563858 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:06.564597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:06.565545 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:06.566013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:06.566482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:06.663176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:06.665160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:06.677053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:06.677869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:06.678617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:06.679896 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:06.680682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:06.681389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:06.747695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:06.748467 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:06.749283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:06.750832 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lazy-loading 'fault' on Instance uuid 72f676c6-6bfd-4c01-b135-da2507403d9d {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:39:06.785256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:06.802578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8a0be8b5-f38b-4f78-8b96-c57d9268bced tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1266 microversion: 2.1 time: 0.251459 Sep 07 13:39:06.803717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 402/818] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:06 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:06.837716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a145e63a44db43acafc92bb2a238f463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1070aeddb0d544f4b3b4c1e41979944d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:06.853988 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-df266d64-4300-4515-9003-4fb99b4f2b2b tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 200 len: 1312 microversion: 2.1 time: 0.199484 Sep 07 13:39:06.855004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 417/819] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:06 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:07.838543 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:07.839323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:07.846941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:07.847664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:07.848172 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:07.848840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:07.849462 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:07.849813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:07.888209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:07.892207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] [instance: 72f676c6-6bfd-4c01-b135-da2507403d9d] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:07.905465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:07.907534 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:07.908413 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:07.909756 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:07.910578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:07.911355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:07.941675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] HTTP exception thrown: Instance 72f676c6-6bfd-4c01-b135-da2507403d9d could not be found. Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Request method failure captured: Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d HTTP/1.1 Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ17TUxo6EfuBC0CdjNCEeEs91aGmysfruTnTQ9124bG-xdwpvpqCxrTPdNUpOLvDDax6OVm9GYvGDzJM5KNyyPoBv1JyDPCdwoa_eZjHVQmYMFZT8CedEiTEuXxeJvwaaOa-o0Gco-PYuO6-Gx86B8J-sf6yrpuZ9Zp3IrtUK8JwVY Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:39:07.945397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1070aeddb0d544f4b3b4c1e41979944d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1070aeddb0d544f4b3b4c1e41979944d", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 1070aeddb0d544f4b3b4c1e41979944d Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1229314611 Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: a145e63a44db43acafc92bb2a238f463 Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1229314611-project Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 72f676c6-6bfd-4c01-b135-da2507403d9d could not be found. Sep 07 13:39:07.949394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '72f676c6-6bfd-4c01-b135-da2507403d9d'} Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f676c6-6bfd-4c01-b135-da2507403d9d could not be found. Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:39:07.952761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f676c6-6bfd-4c01-b135-da2507403d9d could not be found. Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f676c6-6bfd-4c01-b135-da2507403d9d could not be found. Sep 07 13:39:07.956154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:07.960570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] Returning 404 to user: Instance 72f676c6-6bfd-4c01-b135-da2507403d9d could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:39:07.960570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d2d15fa3-0e80-4677-b3bc-c7a7af7ff770 tempest-ServerRescueNegativeTestJSON-1229314611 tempest-ServerRescueNegativeTestJSON-1229314611-project] 10.222.0.62 "GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d" status: 404 len: 111 microversion: 2.1 time: 0.069804 Sep 07 13:39:07.960570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 418/820] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:07 2022] GET /compute/v2.1/servers/72f676c6-6bfd-4c01-b135-da2507403d9d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:39:08.072766 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:08.086718 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-50bbe441-4d92-477f-a9de-7114d82bafa0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1453 microversion: 2.1 time: 0.252411 Sep 07 13:39:08.087863 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 403/821] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:07 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:08.114879 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:08.115488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:08.122510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:08.123213 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:08.123514 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:08.124356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:08.125758 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:08.126239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:08.339261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:08.356461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e80ddef3-98cb-48e7-aca7-9fb82f3be614 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1453 microversion: 2.1 time: 0.246697 Sep 07 13:39:08.358814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 419/822] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:08 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:08.698681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:08.699483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:08.707708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:08.708319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:08.709045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:08.710910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:08.711816 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:08.717590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:08.745864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-32138830-415e-4a75-949f-f3f165001457 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/ips" status: 200 len: 152 microversion: 2.20 time: 0.051561 Sep 07 13:39:08.746605 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 404/823] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Sep 7 13:39:08 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:39:11.214015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:11.216874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:11.226212 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:11.237426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:11.242275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:11.242275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:11.245367 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:11.247915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:11.250328 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:11.373353 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lazy-loading 'flavor' on Instance uuid 561fdee7-7a8f-4e24-98f8-6023d163c251 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:39:11.449826 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:12.126452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-890e2abc-19a9-42ed-aacf-f29de63953a9 req-d152a859-509d-42d1-b497-2c1b68c5ea38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628c7746-90a9-47ed-a112-e91e1a62c0aa", "tag": "9f3289a6-1346-46ed-b353-ce1bdee8b13f"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:12.147314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-890e2abc-19a9-42ed-aacf-f29de63953a9 req-d152a859-509d-42d1-b497-2c1b68c5ea38 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:12.147966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-890e2abc-19a9-42ed-aacf-f29de63953a9 req-d152a859-509d-42d1-b497-2c1b68c5ea38 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:12.148646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-890e2abc-19a9-42ed-aacf-f29de63953a9 req-d152a859-509d-42d1-b497-2c1b68c5ea38 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:12.176245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-890e2abc-19a9-42ed-aacf-f29de63953a9 req-d152a859-509d-42d1-b497-2c1b68c5ea38 service nova] Creating event network-changed:9f3289a6-1346-46ed-b353-ce1bdee8b13f for instance 628c7746-90a9-47ed-a112-e91e1a62c0aa on hv-cinder-85625 Sep 07 13:39:12.185369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-890e2abc-19a9-42ed-aacf-f29de63953a9 req-d152a859-509d-42d1-b497-2c1b68c5ea38 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068221 Sep 07 13:39:12.186529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 405/824] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:39:12.450907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-854e62b3-4d96-4747-beaf-dd014ba0a9c9 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/action" status: 202 len: 0 microversion: 2.20 time: 1.244151 Sep 07 13:39:12.452525 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 420/825] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 7 13:39:11 2022] POST /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/action => generated 0 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:39:12.465169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:12.466339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:12.482716 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:12.491233 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:12.495723 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:12.498316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:12.505874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:12.507581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:12.743625 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:12.762343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:12.765989 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:12.767945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-11f697c3-c813-417f-b21a-ba9cc57dbabb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.308301 Sep 07 13:39:12.768979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 406/826] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:12 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:13.803025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:13.808043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:13.831014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:13.836466 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:13.839885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:13.841324 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:13.845869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:13.846913 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:13.876495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f817876-3083-47e9-b1ce-f1f3457d73ca"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:13.883507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:13.920403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:13.921395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:13.923691 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:13.925055 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:13.925904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:13.926700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:14.123601 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:14.134967 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:14.136989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:14.139322 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-94edbed9-f6ef-4a68-a798-47991b08e86a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.344044 Sep 07 13:39:14.144650 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 421/827] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:13 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:14.147752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Invalid volume: volume 0f817876-3083-47e9-b1ce-f1f3457d73ca is already attached to instances: 162641ad-da96-482a-bfef-b82281e487b5 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: POST /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments HTTP/1.1 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 74 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:39:14.149593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {"volumeAttachment": {"volumeId": "0f817876-3083-47e9-b1ce-f1f3457d73ca"}} Sep 07 13:39:14.152318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Invalid volume: volume 0f817876-3083-47e9-b1ce-f1f3457d73ca is already attached to instances: 162641ad-da96-482a-bfef-b82281e487b5 Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'server_id': '162641ad-da96-482a-bfef-b82281e487b5', 'body': {'volumeAttachment': {'volumeId': '0f817876-3083-47e9-b1ce-f1f3457d73ca'}}} Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f817876-3083-47e9-b1ce-f1f3457d73ca is already attached to instances: 162641ad-da96-482a-bfef-b82281e487b5 Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:14.153932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f817876-3083-47e9-b1ce-f1f3457d73ca is already attached to instances: 162641ad-da96-482a-bfef-b82281e487b5 Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:14.157519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f817876-3083-47e9-b1ce-f1f3457d73ca is already attached to instances: 162641ad-da96-482a-bfef-b82281e487b5 Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 400 to user: Invalid volume: volume 0f817876-3083-47e9-b1ce-f1f3457d73ca is already attached to instances: 162641ad-da96-482a-bfef-b82281e487b5 {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fd131d68-c67a-449e-b710-4f11205c1ef4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.284842 Sep 07 13:39:14.164750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 407/828] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:39:13 2022] POST /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments => generated 174 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:39:14.302041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:14.305949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:14.314843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:14.315773 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:14.316578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:14.317883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:14.318746 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:14.319579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:14.442784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'services' on Instance uuid 162641ad-da96-482a-bfef-b82281e487b5 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:39:14.697165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-176d6501-ddcf-464d-87e7-8395684dc42a tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments/0f817876-3083-47e9-b1ce-f1f3457d73ca" status: 202 len: 0 microversion: 2.1 time: 0.402910 Sep 07 13:39:14.697980 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 422/829] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:39:14 2022] DELETE /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments/0f817876-3083-47e9-b1ce-f1f3457d73ca => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:39:14.711094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:14.714625 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:14.726183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:14.726684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:14.727160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:14.727887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:14.728351 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:14.728777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:14.770671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b8cd2567-02f1-4cb6-8397-5de9322d9564 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065497 Sep 07 13:39:14.772065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 408/830] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:39:14 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:15.193109 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:15.194006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:15.200660 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:15.201170 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:15.201642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:15.202342 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:15.204226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:15.204680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:15.403207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:15.420154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:15.431807 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:15.433989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a0c7581e-2bd4-4395-bcfc-1b933cd10c39 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.247152 Sep 07 13:39:15.435497 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 423/831] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:15 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:15.788791 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:15.791198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:15.837665 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:15.838462 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:15.839139 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:15.840769 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:15.841423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:15.841971 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:15.901779 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f40a121d-72eb-46a4-a310-9cf8f88c9bcf tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117308 Sep 07 13:39:15.902681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 409/832] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:39:15 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:16.478037 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:16.478738 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:16.488976 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:16.489528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:16.490034 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:16.490805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:16.491351 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:16.491815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:16.682611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:16.696316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:16.699162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:16.701168 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2fd2ac27-bab3-4f71-971f-f7f34b4ecb48 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.227178 Sep 07 13:39:16.702117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 424/833] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:16 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:16.919929 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:16.923900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:16.927375 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=70 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:16.934366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:16.935128 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:16.935874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:16.937633 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:16.938436 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:16.939122 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:16.976832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-92bc5442-5cb0-4f08-bf48-5db239fe4c44 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061910 Sep 07 13:39:16.977424 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 410/834] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:39:16 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:39:17.052306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:17.052889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:17.060942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:17.061869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:17.063138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:17.064029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:17.064544 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:17.065176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:17.098590 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:39:17.481272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-51d294c1-aa18-4035-ad4e-0f5218c9c9fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 204 len: 0 microversion: 2.1 time: 0.433641 Sep 07 13:39:17.482477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 425/835] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:39:17 2022] DELETE /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:39:17.494238 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:17.494912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:17.503018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:17.503411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:17.503861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:17.504588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:17.505051 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:17.505509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:17.674493 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:17.683602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5499a53c-8ff7-4fe2-b9db-e5f38ddc1c39 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1681 microversion: 2.1 time: 0.194604 Sep 07 13:39:17.684191 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 411/836] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:17 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:17.737938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:17.738554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:17.745622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:17.747468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:17.747468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:17.747468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:17.747894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:17.748240 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:17.934891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:17.945559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:17.947294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:17.948561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4e0c8108-7017-4f7b-9887-9efa59400213 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.215786 Sep 07 13:39:17.949129 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 426/837] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:17 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:18.709241 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:18.710126 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:18.717723 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:18.719182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:18.719762 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:18.720666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:18.721192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:18.721729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:18.917787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:18.927540 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1f8e7eed-95ec-4386-ab17-d0178900da33 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1681 microversion: 2.1 time: 0.222842 Sep 07 13:39:18.928140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 412/838] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:18 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1681 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:18.995196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:18.995895 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:19.003894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:19.016348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:19.016348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:19.016348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:19.016348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:19.017243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:19.198602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:19.209490 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:19.211057 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:19.212279 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b25c12ad-218f-488f-bbbc-8277b67dba90 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.221962 Sep 07 13:39:19.212873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 427/839] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:18 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:19.954162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:19.954952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:19.962744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:19.963807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:19.964528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:19.965727 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:19.966691 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:19.967457 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:20.240122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:20.241051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:20.248927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:20.249752 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:20.250314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:20.251266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:20.251993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:20.252515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:20.444988 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:20.460839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:20.464548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:20.466881 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3dade506-d8fd-409c-8a4d-ee58b355de52 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.231161 Sep 07 13:39:20.469073 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 428/840] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:20 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:20.601705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:20.622659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ea2e6ac3-3ada-4e47-92a6-fbefb59d769d tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1681 microversion: 2.1 time: 0.673623 Sep 07 13:39:20.623860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 413/841] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:19 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1681 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:21.482062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-8915af11-d716-42a3-bcbc-e58297f5f444 req-e1e09279-cd8c-4c6e-b622-bd445ae1f1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162641ad-da96-482a-bfef-b82281e487b5", "name": "network-vif-deleted", "tag": "bf6e47cf-3233-4efe-b5b8-921efc26ce5d"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:21.520356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:21.527064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:21.530272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8915af11-d716-42a3-bcbc-e58297f5f444 req-e1e09279-cd8c-4c6e-b622-bd445ae1f1ea service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:21.534911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8915af11-d716-42a3-bcbc-e58297f5f444 req-e1e09279-cd8c-4c6e-b622-bd445ae1f1ea service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:21.536334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8915af11-d716-42a3-bcbc-e58297f5f444 req-e1e09279-cd8c-4c6e-b622-bd445ae1f1ea service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:21.554834 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:21.556061 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:21.556896 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:21.563825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:21.563825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:21.563825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:21.564115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-8915af11-d716-42a3-bcbc-e58297f5f444 req-e1e09279-cd8c-4c6e-b622-bd445ae1f1ea service nova] Creating event network-vif-deleted:bf6e47cf-3233-4efe-b5b8-921efc26ce5d for instance 162641ad-da96-482a-bfef-b82281e487b5 on hv-cinder-85625 Sep 07 13:39:21.569581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-8915af11-d716-42a3-bcbc-e58297f5f444 req-e1e09279-cd8c-4c6e-b622-bd445ae1f1ea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102190 Sep 07 13:39:21.570921 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 429/842] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:21.652375 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:21.653524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:21.666833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:21.668603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:21.668603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:21.670398 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:21.671792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:21.681316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:21.762768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:21.783738 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:21.787456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:21.790027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-61180396-42af-47af-96f6-5b823d182497 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.290555 Sep 07 13:39:21.791769 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 414/843] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:21 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:21.810010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:21.824950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-265882bc-c19f-45ef-8118-024d7023aaba tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1613 microversion: 2.1 time: 0.177711 Sep 07 13:39:21.826153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 430/844] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:21 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1613 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:22.821830 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:22.822667 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:22.830806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:22.831334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:22.841007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:22.841007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:22.841007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:22.841007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:22.854027 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:22.855181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:22.866098 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:22.867074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:22.867799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:22.869022 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:22.869800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:22.870543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:22.944618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:22.945120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:22.945606 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:22.946404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'fault' on Instance uuid 162641ad-da96-482a-bfef-b82281e487b5 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:39:23.039775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:23.067503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:23.076666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6b71f473-ad08-4cf6-99fb-4d50d02d89a8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 200 len: 1331 microversion: 2.1 time: 0.211026 Sep 07 13:39:23.078230 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 431/845] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:22 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 1331 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:23.089218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:23.092558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:23.105134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a5606997-7adc-4d78-9fe3-fbb4f0ebcd49 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.277366 Sep 07 13:39:23.105134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 415/846] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:22 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:24.119109 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:24.120007 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:24.128475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:24.129536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:24.130196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:24.131203 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:24.131718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:24.132291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:24.133331 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:24.134622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:24.146415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:24.158593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:24.158593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:24.158593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:24.159765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:39:24.160334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:24.160334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 HTTP/1.1 Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:39:24.160608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:39:24.163994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '162641ad-da96-482a-bfef-b82281e487b5'} Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:39:24.165272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:39:24.167697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:39:24.169569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:39:24.169569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6f66d0b3-543a-41fe-be6d-99d805a1c0c5 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 404 len: 111 microversion: 2.1 time: 0.039149 Sep 07 13:39:24.169569 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 432/847] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:24 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:39:24.176468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d4f88c31-8a65-4b69-957a-648941452c35 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '.version_select at 0x7f174f6bdaf0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:24.325186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d4f88c31-8a65-4b69-957a-648941452c35 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-854749684" status: 202 len: 0 microversion: 2.1 time: 0.159148 Sep 07 13:39:24.326336 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 433/848] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-854749684 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:39:24.345676 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:24.355987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:24.357734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:24.359710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-31b63d65-2c20-4b57-8c4a-a71a79356b5e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.230431 Sep 07 13:39:24.360671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 416/849] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:24 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:25.352189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-770a541c-dbee-49b9-977b-ef708c5ae041 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: .version_select at 0x7f174f6c6af0>, body: {"keypair": {"name": "tempest-keypair-982878496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVaiAcVcmiek+0noEq+Nr+07uO0zEDAuEJnodTTv6SyKjTDvW64zLKxXoSgehKa1NLh3BUftYuQDTEpJ2bo9sQuFhe7X8asIl1T8l0sxpfhyBVAgBoJwyu7A4MW/IdOUw=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:25.377313 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-770a541c-dbee-49b9-977b-ef708c5ae041 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:39:25.383788 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-770a541c-dbee-49b9-977b-ef708c5ae041 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:39:25.401459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:25.403404 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:25.414934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:25.415605 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:25.416171 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:25.416985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:25.417643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:25.418001 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:25.508226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-770a541c-dbee-49b9-977b-ef708c5ae041 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160999 Sep 07 13:39:25.519607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 434/850] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:39:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:25.606138 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:25.608830 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:25.616249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:25.617711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:25.618924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1a1b10f6-f154-4f4e-ae46-86e466802abf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.225774 Sep 07 13:39:25.619533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 417/851] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:25 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:26.650658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:26.651823 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:26.664536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:26.665289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:26.665950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:26.667176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:26.668034 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:26.668769 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:26.870207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:26.880281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:26.882843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:26.883323 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-70d0c7eb-b3d8-4e5d-9f2f-4d4cd11efbd0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.238179 Sep 07 13:39:26.883923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 435/852] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:26 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:27.916675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:27.918015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:27.927503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:27.928248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:27.928962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:27.929994 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:27.930462 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:27.931157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:28.159966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:28.186190 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:28.190109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:28.192434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d1bfa564-bb32-4f4b-845b-330037aff7ab tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.279539 Sep 07 13:39:28.193411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 418/853] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:27 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:29.135029 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1307681138", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834c0-0dea-41cd-83a3-dc66b7dd2f54"}], "security_groups": [{"name": "tempest-securitygroup--1647681232"}], "key_name": "tempest-keypair-982878496", "user_data": "}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:29.228307 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:29.230538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:29.245054 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:29.246277 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:29.247471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:29.248735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:29.249555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:29.250585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:29.289210 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] validate_networks() for [('6b6834c0-0dea-41cd-83a3-dc66b7dd2f54', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:39:29.519258 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:29.532572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:29.535576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:29.537476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-238490be-f5b5-468c-9ec4-014c28d44d87 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1744 microversion: 2.20 time: 0.317143 Sep 07 13:39:29.547683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 419/854] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:29 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1744 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:30.023593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:39:30.023593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:39:30.023593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:39:30.024322 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:39:30.025014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:39:30.042276 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:30.042872 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:30.043391 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:30.044277 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:30.044874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:30.045394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:30.067581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:39:30.072554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Getting quotas for user c5e931aa22344990a0f032159ebc20ad and project 495aadbbe15c4f18a5018f45e8bab423. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:39:30.086716 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:39:30.089319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:39:30.278271 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-787f8aa5-d57b-4921-8e8c-7dca16a1eed0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.148093 Sep 07 13:39:30.279573 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 436/855] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:39:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:39:30.298319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c1a0d51e-4bdd-4e31-9947-c80a911f754c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:30.299018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c1a0d51e-4bdd-4e31-9947-c80a911f754c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:30.385212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c1a0d51e-4bdd-4e31-9947-c80a911f754c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:30.394738 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c1a0d51e-4bdd-4e31-9947-c80a911f754c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1241 microversion: 2.1 time: 0.104901 Sep 07 13:39:30.395472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 420/856] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:30 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:30.595531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:30.597079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:30.609148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:30.610026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:30.610727 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:30.611902 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:30.612374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:30.612816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:30.616154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:30.810063 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:30.822425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:30.825287 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:30.827294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c5ac23d6-3f9a-45a4-9c9d-5f43b41d3985 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1744 microversion: 2.20 time: 0.238590 Sep 07 13:39:30.828217 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 437/857] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:30 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1744 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:31.419999 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b42074f4-5c25-4650-a0fe-96833ecaad3f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:31.421079 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b42074f4-5c25-4650-a0fe-96833ecaad3f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:31.492134 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b42074f4-5c25-4650-a0fe-96833ecaad3f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:31.504284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b42074f4-5c25-4650-a0fe-96833ecaad3f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1241 microversion: 2.1 time: 0.088332 Sep 07 13:39:31.505335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 421/858] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:31 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:31.869862 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:31.870751 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:31.880413 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:31.880955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:31.881433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:31.882196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:31.882728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:31.883296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:32.051275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:32.063235 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:32.065172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:32.066539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d519df74-5dc8-4e56-a53a-86a3b0262086 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1744 microversion: 2.20 time: 0.201738 Sep 07 13:39:32.067145 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 438/859] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:31 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:32.530630 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:32.531526 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:32.538772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:32.539285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:32.539722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:32.540433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:32.540890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:32.541306 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:32.619870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:32.631745 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-51794713-b898-4e38-821a-3bbb1d750b65 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1245 microversion: 2.1 time: 0.105426 Sep 07 13:39:32.632459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 422/860] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:32 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1245 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:33.096144 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:33.096743 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:33.103850 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:33.104335 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:33.104802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:33.105480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:33.105930 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:33.106348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:33.269104 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:33.278833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:33.280765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:33.282177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-50984ab1-c363-40de-aef9-b10adcb8c532 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1744 microversion: 2.20 time: 0.191247 Sep 07 13:39:33.282850 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 439/861] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:33 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:33.658699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:33.659512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:33.669677 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:33.671120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:33.671897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:33.672892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:33.673919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:33.674548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:33.795083 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:33.810873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d4630f8d-8b1a-4f05-b2e3-86089dd90ebd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1245 microversion: 2.1 time: 0.157535 Sep 07 13:39:33.812709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 423/862] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:33 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:34.309444 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:34.310202 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:34.319654 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:34.320400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:34.321248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:34.321994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:34.322461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:34.323712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:34.563159 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:34.577003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:34.580143 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:34.582431 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bd4cb06f-6cdb-452e-9d9d-7552ea230c41 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.276697 Sep 07 13:39:34.583507 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 440/863] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:34 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:34.860266 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:34.863704 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:34.896403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:34.896403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:34.896403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:34.896403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:34.897363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:34.897363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:35.026370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:35.052036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c6e9d4ee-0ebc-455a-97e2-3d16310db547 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1293 microversion: 2.1 time: 0.216897 Sep 07 13:39:35.053512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 424/864] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:34 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1293 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:35.636024 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:35.638325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:35.653925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:35.656001 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:35.657128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:35.658944 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:35.660133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:35.661193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:35.810609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-f7966d00-724c-484d-a923-f257e8167d2b req-54905fec-4c94-4798-8578-675615deb4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561fdee7-7a8f-4e24-98f8-6023d163c251", "name": "network-vif-plugged", "status": "completed", "tag": "0d0f70c6-6951-4686-973c-47ad49591ba2"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:35.846682 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-f7966d00-724c-484d-a923-f257e8167d2b req-54905fec-4c94-4798-8578-675615deb4c6 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:35.847098 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-f7966d00-724c-484d-a923-f257e8167d2b req-54905fec-4c94-4798-8578-675615deb4c6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:35.865000 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-f7966d00-724c-484d-a923-f257e8167d2b req-54905fec-4c94-4798-8578-675615deb4c6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:35.904413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-f7966d00-724c-484d-a923-f257e8167d2b req-54905fec-4c94-4798-8578-675615deb4c6 service nova] Creating event network-vif-plugged:0d0f70c6-6951-4686-973c-47ad49591ba2 for instance 561fdee7-7a8f-4e24-98f8-6023d163c251 on hv-cinder-85625 Sep 07 13:39:35.916520 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-f7966d00-724c-484d-a923-f257e8167d2b req-54905fec-4c94-4798-8578-675615deb4c6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110012 Sep 07 13:39:35.929191 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 425/865] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:39:36.025069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:36.047256 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:36.049810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:36.051656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a165a20b-636f-4a84-8392-9849fa6da8c4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.423097 Sep 07 13:39:36.053000 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 441/866] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:35 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:36.108642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:36.110346 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:36.141784 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:36.142547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:36.143278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:36.147743 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:36.149351 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:36.150478 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:36.318962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:36.337799 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-423ee655-e4d0-4f94-be8b-186ef961b588 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1299 microversion: 2.1 time: 0.240725 Sep 07 13:39:36.339559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 426/867] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:36 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:37.102834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:37.110897 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:37.149683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:37.151312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:37.152416 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:37.161715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:37.163006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:37.164546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:37.372838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:37.376482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:37.389717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:37.390849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:37.392118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:37.393648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:37.394722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:37.395846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:37.427900 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:37.460990 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:37.460990 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:37.460990 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f716d14c-96ed-416a-9c6e-231b02d6b5b2 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.353994 Sep 07 13:39:37.467410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 442/868] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:37 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:37.739804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:37.751484 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-931ce58b-8e43-4ffb-a1ae-73a4e9483f6c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.387256 Sep 07 13:39:37.753850 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 427/869] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:37 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:38.479822 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:38.481175 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:38.508994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:38.510382 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:38.510382 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:38.511040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:38.511482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:38.512052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:38.727137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:38.740966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:38.742601 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:38.744266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fc29c34d-0f7b-4332-967e-c697a8bd05d4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.269284 Sep 07 13:39:38.745480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 443/870] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:38 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:38.787012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:38.788384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:38.801074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:38.801973 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:38.802772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:38.804346 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:38.805486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:38.806498 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:38.973135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-a30e7b36-4e6d-41b4-b69c-6bf43a27ad39 req-30119902-6aec-432c-b35e-8e44494a6f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a025d6-6cc8-4d25-ab96-df4b9315fb47", "tag": "baf08a08-72fc-4c1e-831b-3f79f3451ce5"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:38.993192 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a30e7b36-4e6d-41b4-b69c-6bf43a27ad39 req-30119902-6aec-432c-b35e-8e44494a6f56 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:38.994312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a30e7b36-4e6d-41b4-b69c-6bf43a27ad39 req-30119902-6aec-432c-b35e-8e44494a6f56 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:38.995306 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-a30e7b36-4e6d-41b4-b69c-6bf43a27ad39 req-30119902-6aec-432c-b35e-8e44494a6f56 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:39.012289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-a30e7b36-4e6d-41b4-b69c-6bf43a27ad39 req-30119902-6aec-432c-b35e-8e44494a6f56 service nova] Creating event network-changed:baf08a08-72fc-4c1e-831b-3f79f3451ce5 for instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 on hv-cinder-85625 Sep 07 13:39:39.025732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-a30e7b36-4e6d-41b4-b69c-6bf43a27ad39 req-30119902-6aec-432c-b35e-8e44494a6f56 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062172 Sep 07 13:39:39.027476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 444/871] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:39.100208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:39.117310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-06ce9ba1-2345-4ec9-89e3-806f269b54a1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.338089 Sep 07 13:39:39.131177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 428/872] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:38 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:39.801142 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:39.803764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:39.820774 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:39.823149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:39.827609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:39.827609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:39.827609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:39.828739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:40.054855 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:40.081511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=10 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:40.143304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:40.144163 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:40.155701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:40.162510 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:40.166245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:40.167468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:40.168158 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:40.168616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:40.559898 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:40.569846 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:40.572335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-886f73bb-036d-43e0-881a-a5502e8cfbce tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.433265 Sep 07 13:39:40.591340 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 429/873] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:40 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:40.614564 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:40.616777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:40.618539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-aae87eb1-d034-4366-9292-0487035afadf tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.829925 Sep 07 13:39:40.619883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 445/874] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:39 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:41.602279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:41.603592 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:41.606813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=4 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:41.627193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:41.627778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:41.628230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:41.630406 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:41.632996 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:41.634138 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:41.682370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:41.685387 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:41.700664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:41.703641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:41.705025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:41.705828 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:41.707419 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:41.708510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:41.710172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:41.910009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:41.924449 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c8db19f0-b019-45f9-8f4c-e4acf675ff52 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.325411 Sep 07 13:39:41.924959 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 430/875] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:41 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:42.024461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:42.043578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:42.052163 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:42.055057 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-970321a7-b67a-46a6-a77b-901c82169193 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.379781 Sep 07 13:39:42.056381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 446/876] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:41 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:42.121148 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:42.122144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:42.133796 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:42.134680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:42.135954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:42.137114 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:42.137904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:42.138448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:42.188663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1e694390-acd0-4eaa-87e6-8cae91e12413 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/ips" status: 200 len: 146 microversion: 2.1 time: 0.072654 Sep 07 13:39:42.197062 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 431/877] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:39:42 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/ips => generated 146 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:42.981728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:42.985108 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:43.002322 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:43.005189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:43.005189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:43.006337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:43.007622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:43.008647 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:43.093862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:43.100818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:43.130586 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:43.134783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:43.136052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:43.156989 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:43.158427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:43.162845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:43.379702 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:43.390114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c33b273d-8c6e-427b-8b16-5fc668e417fb tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.417603 Sep 07 13:39:43.407922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 447/878] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:42 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:43.836243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:43.852456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:43.856885 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:43.859406 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-19169d77-ff55-4633-ba7b-60ae9ad49396 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.772899 Sep 07 13:39:43.861272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 432/879] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:43 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:44.403680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecac2e96-380c-4a5d-a62b-fc7e38e634f2"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:44.420840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:44.421633 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:44.426463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:44.454966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.456813 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.458014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:44.460250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.462381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.462909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.463138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.463387 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:44.463991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:44.464581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.465279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.466142 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:44.746613 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:44.769185 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-23f4baad-5e30-48f0-9a3d-f919c0a590f9 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.355135 Sep 07 13:39:44.771281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 433/880] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:44 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:44.912088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:44.913728 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:44.933925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.935120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.936211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:44.938085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.939675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.940772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:45.253423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:45.264656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:45.266774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:45.268323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4c50e63a-497c-4ea7-a136-f44e744cad3f tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.371286 Sep 07 13:39:45.269085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 434/881] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:44 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:45.672685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fc202827-9a4c-4648-aca5-5d8f6a6df94f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.284191 Sep 07 13:39:45.673537 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 448/882] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:39:44 2022] POST /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments => generated 194 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:45.803868 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:45.805029 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:45.835726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:45.836983 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:45.838018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:45.839642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:45.840793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:45.841845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:45.918775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-4775c05c-004f-4995-8461-e1f504f1dad9 req-15cee379-9c69-451a-bafa-172f1002c22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a025d6-6cc8-4d25-ab96-df4b9315fb47", "name": "network-vif-plugged", "status": "completed", "tag": "baf08a08-72fc-4c1e-831b-3f79f3451ce5"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:45.944058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4775c05c-004f-4995-8461-e1f504f1dad9 req-15cee379-9c69-451a-bafa-172f1002c22d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:45.944796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4775c05c-004f-4995-8461-e1f504f1dad9 req-15cee379-9c69-451a-bafa-172f1002c22d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:45.945463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4775c05c-004f-4995-8461-e1f504f1dad9 req-15cee379-9c69-451a-bafa-172f1002c22d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:45.961468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-4775c05c-004f-4995-8461-e1f504f1dad9 req-15cee379-9c69-451a-bafa-172f1002c22d service nova] Creating event network-vif-plugged:baf08a08-72fc-4c1e-831b-3f79f3451ce5 for instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 on hv-cinder-85625 Sep 07 13:39:45.968700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-4775c05c-004f-4995-8461-e1f504f1dad9 req-15cee379-9c69-451a-bafa-172f1002c22d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058360 Sep 07 13:39:45.969949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 449/883] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:46.219645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:46.236259 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f6a2a876-ec06-4946-a5ed-b35f0d8c6689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.441102 Sep 07 13:39:46.238210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 435/884] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:45 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:46.305038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:46.306309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:46.318579 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.319928 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.320994 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.322543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.323893 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.325047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.546367 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:46.576969 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:46.601903 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:46.604757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3066bbd6-bb41-470a-9595-23291354f00c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.309249 Sep 07 13:39:46.607519 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 450/885] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:46 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:47.273435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:47.274229 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:47.284367 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:47.285152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:47.285851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:47.287574 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:47.288825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:47.290024 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:47.585999 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:47.601381 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-eb526da8-b725-4306-817e-a0bcb258ffb6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.340639 Sep 07 13:39:47.602995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 436/886] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:47 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:47.657152 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:47.659600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:47.677890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:47.678710 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:47.679875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:47.681526 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:47.682964 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:47.684051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:47.921240 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:47.931577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:47.933264 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:47.934584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-54f4fb9c-b23a-4624-9001-8dfcff2e2316 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.284178 Sep 07 13:39:47.935149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 451/887] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:47 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:48.643303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:48.644582 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:48.647434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=58 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:48.659413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:48.660416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:48.661325 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:48.662427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:48.663333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:48.664214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:48.693015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:48.890839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:48.902394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6b90532c-1119-4474-8d36-b60485568d16 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1367 microversion: 2.1 time: 0.264365 Sep 07 13:39:48.934487 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 437/888] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:48 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:48.985553 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:48.987054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:49.000480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:49.001312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:49.002144 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:49.003415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:49.004221 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:49.005100 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:49.249961 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:49.261077 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:49.262815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:49.264785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5547d2c1-cc82-463e-a3bc-16b125256df4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1739 microversion: 2.20 time: 0.287713 Sep 07 13:39:49.265564 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 452/889] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:48 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:49.942578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:49.943622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:49.950633 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:49.951077 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:49.951606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:49.952366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:49.952820 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:49.953245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.143122 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:50.152384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d2c61a03-f668-4694-ac10-a3739cc4364c tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1557 microversion: 2.1 time: 0.214316 Sep 07 13:39:50.153036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 438/890] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:49 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:50.180480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:50.181106 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:50.190910 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.191660 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.192214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.193114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.193581 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.194005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.291015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:50.291637 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:50.298764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.299364 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.299839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.300625 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.301121 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.301551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.335654 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-aff8a40c-fda6-4fa7-af94-6cc9657a6bb8 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160399 Sep 07 13:39:50.336637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 453/891] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 7 13:39:50 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:39:50.629828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:50.647121 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:50.649656 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:50.652221 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e46619f6-98fa-4eff-9af9-77a87de573b1 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1721 microversion: 2.20 time: 0.365210 Sep 07 13:39:50.652986 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 439/892] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:50 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:51.700512 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:51.705214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:51.714198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.715104 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.715854 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:51.717135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.718200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.718988 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:51.729264 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:51.960315 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-506e9bd2-f833-430c-a612-d29ae2288f3c req-e3dfdde4-863c-4fe3-9c84-b772989f779f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a025d6-6cc8-4d25-ab96-df4b9315fb47", "tag": "baf08a08-72fc-4c1e-831b-3f79f3451ce5"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:51.974198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-506e9bd2-f833-430c-a612-d29ae2288f3c req-e3dfdde4-863c-4fe3-9c84-b772989f779f service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.975095 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-506e9bd2-f833-430c-a612-d29ae2288f3c req-e3dfdde4-863c-4fe3-9c84-b772989f779f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.975759 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-506e9bd2-f833-430c-a612-d29ae2288f3c req-e3dfdde4-863c-4fe3-9c84-b772989f779f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:51.989793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-506e9bd2-f833-430c-a612-d29ae2288f3c req-e3dfdde4-863c-4fe3-9c84-b772989f779f service nova] Creating event network-changed:baf08a08-72fc-4c1e-831b-3f79f3451ce5 for instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 on hv-cinder-85625 Sep 07 13:39:51.992050 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:51.995514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-506e9bd2-f833-430c-a612-d29ae2288f3c req-e3dfdde4-863c-4fe3-9c84-b772989f779f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040750 Sep 07 13:39:51.996409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 440/893] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:39:52.009065 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:52.012192 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:52.015339 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d76dc842-92ba-426b-94a4-171f8c21b16a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1721 microversion: 2.20 time: 0.322466 Sep 07 13:39:52.015969 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 454/894] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:51 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1721 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:53.047924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:53.049423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:53.057302 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.058203 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.058875 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.059787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.060598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.062476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.329815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:53.365913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:53.372670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:53.375183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1b5a2a35-8823-4295-8571-f15fab4487f6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1721 microversion: 2.20 time: 0.333379 Sep 07 13:39:53.393236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 441/895] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:53 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:53.712827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-3bd0ff27-30aa-4578-8492-d2bc75d0b100 req-5cc558ce-efea-4d06-9090-f18701083c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561fdee7-7a8f-4e24-98f8-6023d163c251", "name": "network-vif-unplugged", "status": "completed", "tag": "0d0f70c6-6951-4686-973c-47ad49591ba2"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:53.729342 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-3bd0ff27-30aa-4578-8492-d2bc75d0b100 req-5cc558ce-efea-4d06-9090-f18701083c1d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.729923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-3bd0ff27-30aa-4578-8492-d2bc75d0b100 req-5cc558ce-efea-4d06-9090-f18701083c1d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.730457 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-3bd0ff27-30aa-4578-8492-d2bc75d0b100 req-5cc558ce-efea-4d06-9090-f18701083c1d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.752314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-3bd0ff27-30aa-4578-8492-d2bc75d0b100 req-5cc558ce-efea-4d06-9090-f18701083c1d service nova] Creating event network-vif-unplugged:0d0f70c6-6951-4686-973c-47ad49591ba2 for instance 561fdee7-7a8f-4e24-98f8-6023d163c251 on hv-cinder-85625 Sep 07 13:39:53.755037 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-3bd0ff27-30aa-4578-8492-d2bc75d0b100 req-5cc558ce-efea-4d06-9090-f18701083c1d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046750 Sep 07 13:39:53.755790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 455/896] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:54.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:54.412697 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:54.423403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.424214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.424912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.426060 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.426720 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.427319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.765212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:54.777426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:54.779431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:54.781427 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-71734832-e614-482c-b936-be4e0f9da467 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1724 microversion: 2.20 time: 0.377439 Sep 07 13:39:54.782594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 442/897] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:54 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:39:54.817078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad71c9ab-472d-4ead-8937-172b634c7cb9"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:54.823913 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:54.840748 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.841720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.842772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.844166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.845065 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.846053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.909993 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:54.913132 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:54.927727 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.928614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.929671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.931015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.931844 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.932835 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.994625 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-880e51d8-77db-487a-a95c-713579cf7ecf tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093399 Sep 07 13:39:54.995921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 443/898] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:39:54 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:55.015958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:55.016777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:55.026242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:55.027459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:55.027663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:55.028563 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:55.029160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:55.030066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:55.077549 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-85401183-5d69-43d1-8a44-d6eb97b3d09c tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/ecac2e96-380c-4a5d-a62b-fc7e38e634f2" status: 200 len: 194 microversion: 2.1 time: 0.066567 Sep 07 13:39:55.078380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 444/899] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Sep 7 13:39:55 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/ecac2e96-380c-4a5d-a62b-fc7e38e634f2 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:56.934236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0aaf0896-d5f3-4ada-ae69-eee36dab564e tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.123998 Sep 07 13:39:56.935663 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 456/900] 10.222.0.62 () {62 vars in 1364 bytes} [Wed Sep 7 13:39:54 2022] POST /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-volume_attachments => generated 188 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:39:57.068771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "081fa53a-55e1-4f94-9e0a-152cf951b3b2"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:57.076908 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:57.079917 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:57.080429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:57.080954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:57.081607 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:57.082669 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:57.082669 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:57.111239 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:57.111779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:57.120155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:57.120650 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:57.121169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:57.122006 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:57.122474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:57.123246 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.032530 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1b9ee377-3651-4f04-a54d-7bf77172d561 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-volume_attachments/ad71c9ab-472d-4ead-8937-172b634c7cb9" status: 202 len: 0 microversion: 2.20 time: 0.925211 Sep 07 13:39:58.035365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 457/901] 10.222.0.62 () {60 vars in 1457 bytes} [Wed Sep 7 13:39:57 2022] DELETE /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-volume_attachments/ad71c9ab-472d-4ead-8937-172b634c7cb9 => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:39:58.137185 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:58.138267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:58.149948 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.150799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.151608 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.152882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.153704 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.154522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.230690 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=151551) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:39:58.330327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3b30e3bc-693b-4b0e-ba50-f2c39ae78101 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "POST /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.264858 Sep 07 13:39:58.330327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 445/902] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:39:57 2022] POST /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments => generated 194 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:39:58.699309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f2e083ec-b224-49fc-91da-918b5825e1fb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "POST /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/action" status: 202 len: 0 microversion: 2.20 time: 0.540783 Sep 07 13:39:58.699309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 458/903] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 7 13:39:58 2022] POST /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:39:58.702368 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:58.703402 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:58.710819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.711508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.711960 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.712691 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.713362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.713804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.903955 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:58.923639 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:58.926962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:58.929355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-97acc78c-f83c-49a6-b481-94f78d2496a6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1672 microversion: 2.20 time: 0.234842 Sep 07 13:39:58.930597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 446/904] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:58 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:39:59.970245 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:59.971522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:59.984357 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:59.985502 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:59.986407 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:59.988154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:59.988991 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:59.989785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:00.225090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:00.236646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:00.238164 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:00.239497 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-15009453-5295-40fc-9475-ed1a7926f94a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1672 microversion: 2.20 time: 0.277100 Sep 07 13:40:00.240301 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 459/905] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:39:59 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1672 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:01.291482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:01.292615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:01.305052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.305926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.306708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:01.308070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.308876 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.309612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:01.532372 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:01.542208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:01.543729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:01.545765 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1be5a11f-eb48-47bf-b204-b9f476087b7c tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1672 microversion: 2.20 time: 0.261714 Sep 07 13:40:01.546425 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 447/906] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:01 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1672 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:02.579323 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:02.580520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:02.596945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:02.597829 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:02.599050 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:02.600403 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:02.601387 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:02.602161 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:02.914364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:02.930939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:02.934218 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:02.936974 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5ed132c2-61df-404b-8823-26f968ac31b5 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.366210 Sep 07 13:40:02.938276 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 460/907] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:02 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:03.995456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:03.996567 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:04.005117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:04.005614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:04.006053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:04.006767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:04.007297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:04.015485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:04.206920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:04.215634 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:04.217330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:04.218836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bf71f900-8a60-4e1b-9241-cd7069ceedb4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.231443 Sep 07 13:40:04.219450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 448/908] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:03 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:05.260900 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:05.262021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:05.289230 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:05.290671 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:05.291489 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:05.293087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:05.294296 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:05.296389 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:05.595708 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:05.608418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:05.617243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:05.617243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-849b7f2f-6f89-4956-a22b-3bd5ef7849b0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.362431 Sep 07 13:40:05.617243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 461/909] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:05 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:06.653665 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:06.655960 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:06.664529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:06.666028 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:06.666937 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:06.667850 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:06.668667 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:06.669148 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:06.914033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:06.926313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:06.929020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:06.930863 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0f162d0e-cecb-40b7-aa44-f966e6af9067 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.283221 Sep 07 13:40:06.943320 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 449/910] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:06 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:07.967664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:07.970047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:07.986316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:07.987632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:07.988641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:07.990535 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:07.991803 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:07.993069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:08.263577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:08.280857 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:08.285825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:08.288402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0a0f9b6a-e520-4148-bda9-6e602d15eceb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.328594 Sep 07 13:40:08.290188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 462/911] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:07 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:09.337456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:09.489394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:09.489394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:09.489394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:09.489394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:09.492160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:09.492160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:09.492160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:09.547859 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:09.562077 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:09.566766 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:09.569588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-00d72f08-d755-457c-b200-072a9bfb2d0a tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.236191 Sep 07 13:40:09.570683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 450/912] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:09 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:10.618110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:10.624070 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:10.626261 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:10.627066 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:10.627739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:10.628836 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:10.629494 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:10.630107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:10.877807 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:10.890952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:10.893137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:10.894790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8ac263bf-5b23-4c29-98d8-f0ee5d9482c0 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.281472 Sep 07 13:40:10.896178 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 463/913] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:10 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:11.923703 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:11.925120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:11.933038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:11.933666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:11.934213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:11.935706 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:11.936246 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:11.936701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:12.163979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:12.179668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:12.182736 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:12.184343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-afea88d0-1fcb-4fe0-8063-b44f24673558 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.265311 Sep 07 13:40:12.186067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 451/914] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:11 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:13.227088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:13.228165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:13.236305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:13.243882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:13.245295 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:13.246305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:13.248002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:13.248734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:13.253622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:13.460950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:13.473329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:13.476424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:13.478810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-16dd045c-7357-4b4e-b8b0-325aa824caf6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.259232 Sep 07 13:40:13.480127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 464/915] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:13 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:14.530359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:14.530359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:14.537032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:14.537533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:14.537977 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:14.538717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:14.539279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:14.539708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:14.721307 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:14.731179 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:14.733618 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:14.734925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7f2e62fd-d121-4c71-aa34-e31de3f7a9f4 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.217254 Sep 07 13:40:14.735529 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 452/916] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:14 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:15.765348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:15.766016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:15.773479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:15.773977 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:15.774411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:15.775578 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:15.775777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:15.776051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:15.781684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:15.964114 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:15.981152 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:15.985417 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:15.987866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c5238fae-56d0-4484-8b00-25e0dfd64802 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.226460 Sep 07 13:40:15.989257 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 465/917] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:15 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:16.319975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:16.324062 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:16.336638 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:16.337517 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:16.338303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:16.339793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:16.340615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:16.342161 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:16.369141 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:16.406106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6e08ac1a-967a-47f1-844b-fb37f0b647a7 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.091299 Sep 07 13:40:16.406106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 453/918] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:40:16 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:16.565533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:16.566187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:16.579796 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:16.580757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:16.581252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:16.582548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:16.583441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:16.584096 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:16.632099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-720233ba-68eb-41dc-b2a7-065a591c3ec3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/ecac2e96-380c-4a5d-a62b-fc7e38e634f2" status: 200 len: 194 microversion: 2.1 time: 0.074353 Sep 07 13:40:16.633110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 466/919] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Sep 7 13:40:16 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/ecac2e96-380c-4a5d-a62b-fc7e38e634f2 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:16.646326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:16.647009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:16.656524 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:16.657578 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:16.657767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:16.658612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:16.659386 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:16.659962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:16.781939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lazy-loading 'services' on Instance uuid 6fe2b587-f946-4e6f-886f-9d61136003f8 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:40:17.034030 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:17.034701 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:17.037509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-be420657-1370-463c-b0f8-198837e34401 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/ecac2e96-380c-4a5d-a62b-fc7e38e634f2" status: 202 len: 0 microversion: 2.1 time: 0.395737 Sep 07 13:40:17.038346 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 454/920] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:40:16 2022] DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/ecac2e96-380c-4a5d-a62b-fc7e38e634f2 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:40:17.052489 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:17.053209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:17.053947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:17.055049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:17.056059 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:17.057692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:17.256719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:17.268258 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:17.270267 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:17.271837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-330d01ad-ea3a-4995-af68-de6b32b46cd8 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.242631 Sep 07 13:40:17.273138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 467/921] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:17 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:18.322102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:18.323505 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:18.335970 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:18.336851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:18.337637 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:18.338927 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:18.340036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:18.340939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:18.567243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:18.586782 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:18.589699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:18.591288 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d4573d13-1c2a-42ee-83a4-a32755a30246 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.278403 Sep 07 13:40:18.591998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 455/922] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:18 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:19.301465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:19.302063 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:19.313507 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:19.314893 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:19.315839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:19.317252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:19.318052 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:19.318794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:19.378215 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3de309d5-4442-41c9-9eac-4eeef7e09c74 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/081fa53a-55e1-4f94-9e0a-152cf951b3b2" status: 200 len: 194 microversion: 2.1 time: 0.080943 Sep 07 13:40:19.378838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 468/923] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Sep 7 13:40:19 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/081fa53a-55e1-4f94-9e0a-152cf951b3b2 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:19.395033 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:19.396093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:19.400767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=38 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:19.410711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:19.411638 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:19.412314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:19.413525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:19.414330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:19.415177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:19.521760 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lazy-loading 'services' on Instance uuid 6fe2b587-f946-4e6f-886f-9d61136003f8 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:40:19.641883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:19.643772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:19.656646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:19.657641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:19.658914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:19.664755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:19.664755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:19.664755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:19.839153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0e1d18aa-d809-4684-a9aa-d61c2429b6b3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/081fa53a-55e1-4f94-9e0a-152cf951b3b2" status: 202 len: 0 microversion: 2.1 time: 0.450998 Sep 07 13:40:19.840081 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 456/924] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:40:19 2022] DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments/081fa53a-55e1-4f94-9e0a-152cf951b3b2 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:40:19.897772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-e3a59316-3b34-47ac-9305-83d13dc5c54d req-258910f9-08d8-4abf-bf08-e376f91050ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561fdee7-7a8f-4e24-98f8-6023d163c251", "name": "network-vif-plugged", "status": "completed", "tag": "0d0f70c6-6951-4686-973c-47ad49591ba2"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:19.921222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e3a59316-3b34-47ac-9305-83d13dc5c54d req-258910f9-08d8-4abf-bf08-e376f91050ad service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:19.922583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e3a59316-3b34-47ac-9305-83d13dc5c54d req-258910f9-08d8-4abf-bf08-e376f91050ad service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:19.923094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-e3a59316-3b34-47ac-9305-83d13dc5c54d req-258910f9-08d8-4abf-bf08-e376f91050ad service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:19.941102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-e3a59316-3b34-47ac-9305-83d13dc5c54d req-258910f9-08d8-4abf-bf08-e376f91050ad service nova] Creating event network-vif-plugged:0d0f70c6-6951-4686-973c-47ad49591ba2 for instance 561fdee7-7a8f-4e24-98f8-6023d163c251 on hv-cinder-85625 Sep 07 13:40:19.947563 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-e3a59316-3b34-47ac-9305-83d13dc5c54d req-258910f9-08d8-4abf-bf08-e376f91050ad service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054297 Sep 07 13:40:19.948283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 457/925] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:40:19.951166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:19.965334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:19.969947 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:19.972580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c37aced3-57af-421e-865a-162453179e67 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.338505 Sep 07 13:40:19.974153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 469/926] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:19 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:21.009239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:21.010341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:21.018122 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:21.018532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:21.019239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:21.020213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:21.020815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:21.021523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:21.267313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:21.277042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:21.278562 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:21.279866 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9cdadb34-6f44-4a3d-bd31-c668ed6721ca tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.275651 Sep 07 13:40:21.280450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 458/927] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:21 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:22.218757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:22.223088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:22.234243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.234815 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.235517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.236732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.237745 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.238827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.290422 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-832a4223-de5e-4789-ad26-8009bba6b24b tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079350 Sep 07 13:40:22.291021 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 470/928] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:40:22 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:40:22.313862 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:22.314684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:22.322019 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.322507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.323205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.323941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.324402 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.324948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.471350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:22.473710 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:22.483771 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.487428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.487428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.487428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.487428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.489129 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.510447 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:22.522852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:22.523189 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ba4a75c9-b6c0-415a-8e09-f9aaf9f9c5c6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057355 Sep 07 13:40:22.523778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 471/929] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:40:22 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:40:22.539154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:22.539154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d273aaf8-460d-4d92-a55a-884c3fce9912 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.222048 Sep 07 13:40:22.539154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 459/930] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:22 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:22.630153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:22.630667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:22.637179 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.638216 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.638692 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.639437 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:22.639922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:22.640371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:22.670427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:40:23.125318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2d742b8a-f080-4f95-89c7-42ec507ab1d1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 204 len: 0 microversion: 2.1 time: 0.498944 Sep 07 13:40:23.129943 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 472/931] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:40:22 2022] DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:40:23.137159 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:23.139195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:23.151144 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:23.155175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:23.155175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:23.155175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:23.155783 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:23.156576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:23.348591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:23.358003 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4b70176a-033a-4eec-b528-2532ecc27ac3 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1671 microversion: 2.1 time: 0.226425 Sep 07 13:40:23.358701 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 460/932] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:23 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:23.558174 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:23.560201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:23.568288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:23.569033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:23.570869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:23.571922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:23.572681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:23.573221 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:23.799681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:23.815901 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:23.819200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:23.821312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d2139b9d-e901-40f2-9eaf-d054e1be6220 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.267402 Sep 07 13:40:23.822350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 473/933] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:23 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:24.383585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:24.384336 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:24.392780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:24.393393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:24.393839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:24.394675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:24.395185 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:24.395614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:24.560431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:24.569015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2dffd374-fd36-4052-b4c3-8db06bfb0e52 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1671 microversion: 2.1 time: 0.190242 Sep 07 13:40:24.569917 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 461/934] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:24 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:24.852714 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:24.853787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:24.865590 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:24.866598 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:24.867074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:24.868087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:24.868582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:24.869250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:25.084915 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:25.097639 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:25.100171 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:25.101609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1d71a6a8-11fd-46a8-861a-a74a65877360 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1730 microversion: 2.20 time: 0.255213 Sep 07 13:40:25.102204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 474/935] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:24 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:40:25.596548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:25.598215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:25.607652 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:25.608208 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:25.608948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:25.610408 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:25.611223 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:25.611935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:25.884261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:25.895503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4731d566-321a-475b-8506-5a102f5a04a4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1671 microversion: 2.1 time: 0.304646 Sep 07 13:40:25.896247 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 462/936] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:25 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1671 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:26.155544 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:26.157732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:26.169562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:26.171532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:26.176462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:26.176462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:26.176462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:26.176462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:26.395767 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:26.408369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:26.410462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:26.415731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2b0e1a1d-41ae-463a-a041-028e1585cd08 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1717 microversion: 2.20 time: 0.267815 Sep 07 13:40:26.415731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 475/937] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:40:26 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1717 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:40:26.475270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-a6f0ed8a-4cd1-4edb-8a50-2b0a25eee8ad req-b8dc5dec-d89e-4229-85cf-3a1a5be0544f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe2b587-f946-4e6f-886f-9d61136003f8", "name": "network-vif-deleted", "tag": "93d79f52-dace-42c9-8bb3-b2f4a37d5daf"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:26.497812 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a6f0ed8a-4cd1-4edb-8a50-2b0a25eee8ad req-b8dc5dec-d89e-4229-85cf-3a1a5be0544f service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:26.498593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a6f0ed8a-4cd1-4edb-8a50-2b0a25eee8ad req-b8dc5dec-d89e-4229-85cf-3a1a5be0544f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:26.499277 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a6f0ed8a-4cd1-4edb-8a50-2b0a25eee8ad req-b8dc5dec-d89e-4229-85cf-3a1a5be0544f service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:26.514869 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-a6f0ed8a-4cd1-4edb-8a50-2b0a25eee8ad req-b8dc5dec-d89e-4229-85cf-3a1a5be0544f service nova] Creating event network-vif-deleted:93d79f52-dace-42c9-8bb3-b2f4a37d5daf for instance 6fe2b587-f946-4e6f-886f-9d61136003f8 on hv-cinder-85625 Sep 07 13:40:26.521512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-a6f0ed8a-4cd1-4edb-8a50-2b0a25eee8ad req-b8dc5dec-d89e-4229-85cf-3a1a5be0544f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050243 Sep 07 13:40:26.522951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 463/938] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:26.922295 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:26.922908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:26.930929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:26.931497 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:26.931950 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:26.932689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:26.933213 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:26.933868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:26.978125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:26.979177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:26.979812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:26.980450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lazy-loading 'fault' on Instance uuid 6fe2b587-f946-4e6f-886f-9d61136003f8 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:40:27.049100 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:27.059138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ee0ede39-e59b-4113-9e19-a5f17d386fe1 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1326 microversion: 2.1 time: 0.141931 Sep 07 13:40:27.067126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 476/939] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:26 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:28.100066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:28.104344 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:28.117777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:28.118617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:28.119281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:28.120110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:28.120586 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:28.121056 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:28.178121 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:28.179004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:28.179654 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:28.180399 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lazy-loading 'fault' on Instance uuid 6fe2b587-f946-4e6f-886f-9d61136003f8 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:40:28.297154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7db29f64934026abbe96d5cb5baf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e892aa9df049c387360b67c5e2e065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:28.311247 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1e854c67-71f7-4c6b-8695-19925d20d519 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 200 len: 1326 microversion: 2.1 time: 0.219406 Sep 07 13:40:28.312730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 464/940] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:28 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 1326 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:29.337992 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:29.339207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:29.350246 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:29.354655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:29.354655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:29.354655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:29.355266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:29.356018 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:29.383225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] HTTP exception thrown: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Request method failure captured: Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 HTTP/1.1 Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2EXa52TDpYl8aAWcOGKhbuVDszmIstIdmAHZFLAVZFgSf-68tvlhjz8cTa3JlF4oaIEgeYyus64s27x8MfkyN3vBeBmgmYD8nbJVjAblQzdvQKr4-uY5DtOAmfi-UHt9mY5KbYfNqDvS0X6piTVFgHSIOixBVxs4K711mejMmQtSQ Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:40:29.387003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0e892aa9df049c387360b67c5e2e065", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 7e7db29f64934026abbe96d5cb5baf25 Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:29.395861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '6fe2b587-f946-4e6f-886f-9d61136003f8'} Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:29.397760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:29.400593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:29.402927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Returning 404 to user: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:29.402927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ff2cdbb4-fabc-4fab-9934-65322160e1b6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 404 len: 111 microversion: 2.1 time: 0.056360 Sep 07 13:40:29.402927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 477/941] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:29 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:40:29.404912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b3632c54-f7da-48db-acc7-c48f5a65ccd4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '.version_select at 0x7f1747c24b80>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:29.560869 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b3632c54-f7da-48db-acc7-c48f5a65ccd4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-550163045" status: 202 len: 0 microversion: 2.1 time: 0.163734 Sep 07 13:40:29.561803 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 465/942] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-550163045 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:40:30.035625 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:30.036958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:30.050342 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:30.051673 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:30.052762 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:30.054341 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:30.055488 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:30.056495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:30.112840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b2dcc6dc-e2db-459a-a461-4ca811b8768b tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/ips" status: 200 len: 150 microversion: 2.1 time: 0.093673 Sep 07 13:40:30.113799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 478/943] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:40:30 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:40:32.195512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dab8af3f-764e-45d7-b455-93b65927dcda"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:32.198015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:32.207430 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:32.207939 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:32.208385 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:32.209111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:32.209583 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:32.210018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:33.358789 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a73cbc84-a89a-4276-b87d-e4f7b36b01dc tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "POST /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.167202 Sep 07 13:40:33.359705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 466/944] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:40:32 2022] POST /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments => generated 194 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:33.902862 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:33.903629 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:33.912287 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:33.912825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:33.913270 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:33.914031 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:33.914498 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:33.915005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:33.932747 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] HTTP exception thrown: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Request method failure captured: Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 HTTP/1.1 Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2EXa52TDpYl8aAWcOGKhbuVDszmIstIdmAHZFLAVZFgSf-68tvlhjz8cTa3JlF4oaIEgeYyus64s27x8MfkyN3vBeBmgmYD8nbJVjAblQzdvQKr4-uY5DtOAmfi-UHt9mY5KbYfNqDvS0X6piTVFgHSIOixBVxs4K711mejMmQtSQ Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:40:33.934016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0e892aa9df049c387360b67c5e2e065", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 7e7db29f64934026abbe96d5cb5baf25 Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.936040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '6fe2b587-f946-4e6f-886f-9d61136003f8'} Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:33.936908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.938288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.939971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Returning 404 to user: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:33.939971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-77c5b94f-42b7-43fd-85a5-c0b7c76fb73a tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 404 len: 111 microversion: 2.1 time: 0.038155 Sep 07 13:40:33.939971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 479/945] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:40:33 2022] DELETE /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:40:33.947590 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:33.948292 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: 6fe2b587-f946-4e6f-886f-9d61136003f8] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:33.955674 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:33.956297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:33.956793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:33.957689 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:33.958161 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:33.958591 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:33.976639 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] HTTP exception thrown: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Request method failure captured: Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 HTTP/1.1 Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2EXa52TDpYl8aAWcOGKhbuVDszmIstIdmAHZFLAVZFgSf-68tvlhjz8cTa3JlF4oaIEgeYyus64s27x8MfkyN3vBeBmgmYD8nbJVjAblQzdvQKr4-uY5DtOAmfi-UHt9mY5KbYfNqDvS0X6piTVFgHSIOixBVxs4K711mejMmQtSQ Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:40:33.978472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0e892aa9df049c387360b67c5e2e065", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 7e7db29f64934026abbe96d5cb5baf25 Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.980814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '6fe2b587-f946-4e6f-886f-9d61136003f8'} Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:33.982644 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. Sep 07 13:40:33.984871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:33.986903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Returning 404 to user: Instance 6fe2b587-f946-4e6f-886f-9d61136003f8 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:33.986903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2df5e3b5-0b04-4df8-9136-2dc4929fb4d4 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8" status: 404 len: 111 microversion: 2.1 time: 0.037620 Sep 07 13:40:33.986903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 467/946] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:33 2022] GET /compute/v2.1/servers/6fe2b587-f946-4e6f-886f-9d61136003f8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:40:35.379496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:35.383883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:35.388583 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:35.389467 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:35.389889 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:35.390698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:35.391356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:35.391847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:35.409555 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] HTTP exception thrown: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Request method failure captured: Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f HTTP/1.1 Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2EXa52TDpYl8aAWcOGKhbuVDszmIstIdmAHZFLAVZFgSf-68tvlhjz8cTa3JlF4oaIEgeYyus64s27x8MfkyN3vBeBmgmYD8nbJVjAblQzdvQKr4-uY5DtOAmfi-UHt9mY5KbYfNqDvS0X6piTVFgHSIOixBVxs4K711mejMmQtSQ Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:40:35.411841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0e892aa9df049c387360b67c5e2e065", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 7e7db29f64934026abbe96d5cb5baf25 Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.414521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': 'cd3d8fa7-7daf-4ceb-9906-985ba2fe332f'} Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:35.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.420810 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.423741 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Returning 404 to user: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:35.423741 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e48e239a-1e44-4a65-ace8-9cc3f970b5e6 tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 404 len: 111 microversion: 2.1 time: 0.040228 Sep 07 13:40:35.423741 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 480/947] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:40:35 2022] DELETE /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:40:35.426282 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:35.427116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] [instance: cd3d8fa7-7daf-4ceb-9906-985ba2fe332f] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:35.435962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:35.436744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:35.437403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:35.438232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:35.438699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:35.439182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:35.464162 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] HTTP exception thrown: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Request method failure captured: Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f HTTP/1.1 Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2EXa52TDpYl8aAWcOGKhbuVDszmIstIdmAHZFLAVZFgSf-68tvlhjz8cTa3JlF4oaIEgeYyus64s27x8MfkyN3vBeBmgmYD8nbJVjAblQzdvQKr4-uY5DtOAmfi-UHt9mY5KbYfNqDvS0X6piTVFgHSIOixBVxs4K711mejMmQtSQ Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:40:35.467712 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0e892aa9df049c387360b67c5e2e065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0e892aa9df049c387360b67c5e2e065", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: e0e892aa9df049c387360b67c5e2e065 Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-737709158 Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 7e7db29f64934026abbe96d5cb5baf25 Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeTestJSON-737709158-project Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.471145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': 'cd3d8fa7-7daf-4ceb-9906-985ba2fe332f'} Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:35.472813 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. Sep 07 13:40:35.475737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:35.477790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] Returning 404 to user: Instance cd3d8fa7-7daf-4ceb-9906-985ba2fe332f could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:35.477790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d0ce6d57-1dd0-402b-b958-e53898f7472f tempest-AttachVolumeTestJSON-737709158 tempest-AttachVolumeTestJSON-737709158-project] 10.222.0.62 "GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f" status: 404 len: 111 microversion: 2.1 time: 0.048873 Sep 07 13:40:35.477790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 468/948] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:35 2022] GET /compute/v2.1/servers/cd3d8fa7-7daf-4ceb-9906-985ba2fe332f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:40:42.437908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:42.438753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:42.451854 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:42.452643 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:42.453622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:42.454845 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:42.455847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:42.456859 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:42.589165 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'services' on Instance uuid 28a025d6-6cc8-4d25-ab96-df4b9315fb47 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:40:42.596111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:42.889816 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-79c2e65b-a095-4ff4-add2-3aa754049b11 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments/dab8af3f-764e-45d7-b455-93b65927dcda" status: 202 len: 0 microversion: 2.1 time: 0.459061 Sep 07 13:40:42.890940 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 481/949] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:40:42 2022] DELETE /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments/dab8af3f-764e-45d7-b455-93b65927dcda => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:40:42.902227 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:42.906766 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:42.919856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:42.920609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:42.922007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:42.922463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:42.923188 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:42.923910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:42.969509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6f694881-ae96-49ec-916e-b0b720a685c6 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073218 Sep 07 13:40:42.970205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 469/950] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:40:42 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:43.598344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1cf3efc2-1945-466c-9f4c-db2618567a83 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Action: 'create', calling method: .version_select at 0x7f174f639af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1750432870", "metadata": {"Type": "work"}}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:43.987839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:43.991531 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:44.003734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:44.004662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:44.005428 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:44.006720 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:44.007555 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:44.008303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:44.228211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:44.236918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-2b542a7e-be9b-42f4-9633-f461e29c3253 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.257635 Sep 07 13:40:44.240774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 470/951] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:40:43 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments => generated 197 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:44.499749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1cf3efc2-1945-466c-9f4c-db2618567a83 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.069558 Sep 07 13:40:44.501283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 482/952] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 7 13:40:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1072 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:40:44.516143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e326e0d3-7aa0-452e-b1f7-8ee63c1d564e tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f1747c111f0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:44.574567 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e326e0d3-7aa0-452e-b1f7-8ee63c1d564e tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 200 len: 353 microversion: 2.1 time: 0.063352 Sep 07 13:40:44.575214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 471/953] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:44 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:45.253797 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:45.256390 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:45.259275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:45.265830 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:45.266334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:45.266776 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:45.267600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:45.268067 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:45.268502 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:45.305184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-527bb953-bb48-4ac8-99fd-6a34f018ab75 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055438 Sep 07 13:40:45.305779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 483/954] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:40:45 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:40:45.405978 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:45.406842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:45.413714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:45.414204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:45.414641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:45.415386 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:45.415839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:45.416260 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:45.447052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Going to try to terminate instance {{(pid=151552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:40:45.589318 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0f185fe8-b0f0-42a4-beaf-224c59a0b026 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f1747cf1160>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:45.653475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0f185fe8-b0f0-42a4-beaf-224c59a0b026 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 200 len: 354 microversion: 2.1 time: 0.067051 Sep 07 13:40:45.655012 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 484/955] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:45 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:40:45.669843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-29ddcdc7-0cac-42bb-a9d0-fca1f434a2b3 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f174f6bd9d0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:45.722317 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-29ddcdc7-0cac-42bb-a9d0-fca1f434a2b3 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 200 len: 354 microversion: 2.1 time: 0.056712 Sep 07 13:40:45.733025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 485/956] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:45 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:40:45.750626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-16ed28b8-e0a9-4dcc-b67c-96e25a632de9 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f174f639c10>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:45.942613 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-34c1e231-38f8-478f-bd9b-2b33e18ba459 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 204 len: 0 microversion: 2.1 time: 0.540719 Sep 07 13:40:45.943576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 472/957] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:40:45 2022] DELETE /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:40:45.954432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:45.955587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:45.963788 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:45.964693 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:45.966044 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:45.967286 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:45.968059 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:45.968819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:46.094000 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-16ed28b8-e0a9-4dcc-b67c-96e25a632de9 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 202 len: 0 microversion: 2.1 time: 0.347083 Sep 07 13:40:46.099685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 486/958] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:40:45 2022] DELETE /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:40:46.107304 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f2c0cb2f-6f52-4871-8315-0a72f14a88a8 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f174f69aa60>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:46.136792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:46.147350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b957cb68-3250-4e43-9738-481d65cbfc68 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1682 microversion: 2.1 time: 0.197930 Sep 07 13:40:46.162416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 473/959] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:45 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:40:46.165225 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f2c0cb2f-6f52-4871-8315-0a72f14a88a8 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 200 len: 353 microversion: 2.1 time: 0.065199 Sep 07 13:40:46.166506 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 487/960] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:46 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:47.184516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:47.185463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:47.186031 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fba26116-fae3-45c3-a49f-6291abc15aed tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f174f639f70>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:47.193083 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:47.193466 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:47.194113 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:47.203600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:47.203600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:47.203600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:47.273253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fba26116-fae3-45c3-a49f-6291abc15aed tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 200 len: 353 microversion: 2.1 time: 0.091318 Sep 07 13:40:47.274391 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 488/961] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:47 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:47.390145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:47.401416 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0070d498-5535-4cc3-8fc6-b639831ae2f4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1682 microversion: 2.1 time: 0.220940 Sep 07 13:40:47.402012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 474/962] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:47 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:48.296456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-87cb69c2-b445-45cc-8653-869317823b07 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f174f6e1670>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:48.377612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-87cb69c2-b445-45cc-8653-869317823b07 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 200 len: 353 microversion: 2.1 time: 0.086595 Sep 07 13:40:48.378475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 489/963] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:48 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:40:48.426806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:48.427723 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:48.437839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:48.438477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:48.438933 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:48.439718 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:48.440190 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:48.440738 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:48.625474 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:48.634483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-01bc92e4-fa00-4ddb-a598-951a40f8dad1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1682 microversion: 2.1 time: 0.211915 Sep 07 13:40:48.635195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 475/964] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:48 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:40:49.400235 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-287bb64d-3093-49d0-a472-bcfeb7e22514 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f174f6e1160>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:49.460938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-287bb64d-3093-49d0-a472-bcfeb7e22514 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 200 len: 353 microversion: 2.1 time: 0.064908 Sep 07 13:40:49.461524 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 490/965] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:49 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:49.660321 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:49.660981 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:49.663843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:49.669923 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:49.670572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:49.671038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:49.671771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:49.672236 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:49.672666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:49.876920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:49.891770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a981ff96-cae0-4ed8-a6d2-b4c4fd697825 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1682 microversion: 2.1 time: 0.235727 Sep 07 13:40:49.892773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 476/966] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:49 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:50.486822 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-70e176ac-abbd-4453-bc97-26d69aa46980 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Calling method '.version_select at 0x7f174f6bde50>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:50.532463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-70e176ac-abbd-4453-bc97-26d69aa46980 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] HTTP exception thrown: Volume fd72a0ac-12ca-44a1-8429-2be6fe92452e could not be found. Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-70e176ac-abbd-4453-bc97-26d69aa46980 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Request method failure captured: Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e HTTP/1.1 Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ9bMhKMKLBCu-WYjmyX2S_csXRBWqWY4bkM0cAt__atA96mNDsDFkDPyeNRKzN0TNqqcEOU9E7PrdUuatzXdcSXxdUfYDdF3lHiCvxn2d7Kz9F1xsbJ6k8GgdjwefK_sp2yJcPWtAXjq4-YcOoQ3DyfVjzFHZixu_HdpxG1vjAHaIY Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 272e8d8d92e54e14854aac920bb29ebf Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesGetTestJSON-1914725324 Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:40:50.535754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/272e8d8d92e54e14854aac920bb29ebf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/272e8d8d92e54e14854aac920bb29ebf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/272e8d8d92e54e14854aac920bb29ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_272e8d8d92e54e14854aac920bb29ebf", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesGetTestJSON-1914725324 Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 272e8d8d92e54e14854aac920bb29ebf Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesGetTestJSON-1914725324 Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesGetTestJSON-1914725324-project Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: ea8d8f20806d42d9952906ea73d50642 Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesGetTestJSON-1914725324-project Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Volume fd72a0ac-12ca-44a1-8429-2be6fe92452e could not be found. Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': 'fd72a0ac-12ca-44a1-8429-2be6fe92452e'} Sep 07 13:40:50.538242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd72a0ac-12ca-44a1-8429-2be6fe92452e could not be found. (HTTP 404) (Request-ID: req-bc1a41e9-9fc5-408a-be91-5b739a371d95) Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:50.545729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:40:50.549211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd72a0ac-12ca-44a1-8429-2be6fe92452e could not be found. Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:40:50.550917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd72a0ac-12ca-44a1-8429-2be6fe92452e could not be found. Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd72a0ac-12ca-44a1-8429-2be6fe92452e could not be found. Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-70e176ac-abbd-4453-bc97-26d69aa46980 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] Returning 404 to user: Volume fd72a0ac-12ca-44a1-8429-2be6fe92452e could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-70e176ac-abbd-4453-bc97-26d69aa46980 tempest-VolumesGetTestJSON-1914725324 tempest-VolumesGetTestJSON-1914725324-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e" status: 404 len: 109 microversion: 2.1 time: 0.062530 Sep 07 13:40:50.552486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 491/967] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:40:50 2022] GET /compute/v2.1/os-volumes/fd72a0ac-12ca-44a1-8429-2be6fe92452e => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:40:50.922157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:50.924135 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:50.937670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:50.938619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:50.939451 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:50.940768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:50.941635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:50.942705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:51.376192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:51.388107 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1578d892-f34f-4de4-9a39-1341513b85a2 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1682 microversion: 2.1 time: 0.472946 Sep 07 13:40:51.388830 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 477/968] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:50 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1682 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:52.223129 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-4b4267b9-ac7d-4ea8-b4a7-26cf2150df7d req-628be7f1-d21f-4c51-9974-6f21a13b5661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a025d6-6cc8-4d25-ab96-df4b9315fb47", "name": "network-vif-deleted", "tag": "baf08a08-72fc-4c1e-831b-3f79f3451ce5"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:52.250413 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4b4267b9-ac7d-4ea8-b4a7-26cf2150df7d req-628be7f1-d21f-4c51-9974-6f21a13b5661 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:52.251411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4b4267b9-ac7d-4ea8-b4a7-26cf2150df7d req-628be7f1-d21f-4c51-9974-6f21a13b5661 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:52.252125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-4b4267b9-ac7d-4ea8-b4a7-26cf2150df7d req-628be7f1-d21f-4c51-9974-6f21a13b5661 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:52.285585 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-4b4267b9-ac7d-4ea8-b4a7-26cf2150df7d req-628be7f1-d21f-4c51-9974-6f21a13b5661 service nova] Creating event network-vif-deleted:baf08a08-72fc-4c1e-831b-3f79f3451ce5 for instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 on hv-cinder-85625 Sep 07 13:40:52.296272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-4b4267b9-ac7d-4ea8-b4a7-26cf2150df7d req-628be7f1-d21f-4c51-9974-6f21a13b5661 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081701 Sep 07 13:40:52.297360 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 492/969] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:52.434998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:52.444210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:52.453296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:52.461450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:52.461450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:52.461450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:52.461450 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:52.462150 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:52.577699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:52.594920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-39e346a8-4eb8-480a-ba56-e2425cc195d1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1326 microversion: 2.1 time: 0.166884 Sep 07 13:40:52.604008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 478/970] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:52 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1326 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:53.647235 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:53.647235 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:53.658319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:53.659248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:53.660307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:53.661626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:53.662495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:53.663379 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:53.721658 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:53.722145 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:53.722664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:53.723251 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lazy-loading 'fault' on Instance uuid 28a025d6-6cc8-4d25-ab96-df4b9315fb47 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:40:53.815989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e931aa22344990a0f032159ebc20ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495aadbbe15c4f18a5018f45e8bab423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:53.838558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9bcc2c64-f434-40eb-9f97-e1853c006771 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 200 len: 1331 microversion: 2.1 time: 0.204710 Sep 07 13:40:53.841580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 493/971] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:53 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 1331 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:40:54.889256 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:54.891818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:54.905244 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:54.905840 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:54.906426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:54.908078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:54.908845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:54.909836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:54.947065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 HTTP/1.1 Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:40:54.948792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:54.952568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '28a025d6-6cc8-4d25-ab96-df4b9315fb47'} Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:54.956205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:54.961747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:54.974388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:54.974388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-64f29732-e487-49bb-bb4f-b9adde2e77b4 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 404 len: 111 microversion: 2.1 time: 0.068206 Sep 07 13:40:54.974388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 479/972] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:54 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:40:54.976339 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-414496db-20ac-48af-8e62-af694b9335ae tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '.version_select at 0x7f174f6f7ca0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:55.081477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-414496db-20ac-48af-8e62-af694b9335ae tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982878496" status: 202 len: 0 microversion: 2.1 time: 0.116808 Sep 07 13:40:55.083002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 494/973] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 7 13:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982878496 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:40:59.909576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:59.910908 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:59.921131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:59.921131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:59.921131 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:59.921838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:59.922369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:59.923007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:59.939775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: DELETE /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 HTTP/1.1 Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:40:59.941888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:59.944635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '28a025d6-6cc8-4d25-ab96-df4b9315fb47'} Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:59.946348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:40:59.949919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:40:59.953356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:59.953356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ac489cb8-a3f0-4237-afd4-2499b22ed689 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 404 len: 111 microversion: 2.1 time: 0.039064 Sep 07 13:40:59.953356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 480/974] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:40:59 2022] DELETE /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:40:59.963116 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:59.964068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 28a025d6-6cc8-4d25-ab96-df4b9315fb47] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:59.977341 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:59.978273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:59.978936 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:59.979844 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:59.980948 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:59.981523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.001916 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 HTTP/1.1 Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:41:00.004423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:41:00.007540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '28a025d6-6cc8-4d25-ab96-df4b9315fb47'} Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:00.008847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. Sep 07 13:41:00.010750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:00.013274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 28a025d6-6cc8-4d25-ab96-df4b9315fb47 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:00.013274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fe15b611-d050-4ffd-b4a7-08c6fccd136f tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47" status: 404 len: 111 microversion: 2.1 time: 0.051540 Sep 07 13:41:00.013274 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 495/975] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:59 2022] GET /compute/v2.1/servers/28a025d6-6cc8-4d25-ab96-df4b9315fb47 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:00.173985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:00.182257 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:00.185963 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.186516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.187043 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.187887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.188440 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.189152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.248592 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7632b3bf-25b9-4be4-8a21-e35bbe848bfb tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.078004 Sep 07 13:41:00.248592 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 481/976] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 7 13:41:00 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:00.359753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:00.360740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:00.376081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.376775 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.377302 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.378211 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.378746 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.379265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.411785 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:41:00.820611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-de703940-cb9c-461d-8f26-91df9d53c805 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 204 len: 0 microversion: 2.20 time: 0.470235 Sep 07 13:41:00.821601 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 496/977] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 7 13:41:00 2022] DELETE /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:41:00.834004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:00.835120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:00.845294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.846184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.846842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.847948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.848475 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.848952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.038872 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:01.049305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:01.050866 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:01.052276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-05b37b69-672b-41b7-b705-c90c761e9298 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.223002 Sep 07 13:41:01.052847 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 482/978] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:41:00 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:41:01.435260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:01.435979 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:01.443689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.444234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.444681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.445477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.446010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.446574 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.462780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 HTTP/1.1 Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:41:01.464680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.467711 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '162641ad-da96-482a-bfef-b82281e487b5'} Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:01.469252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.471808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.474446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:01.474446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-ee73114a-0629-4907-91e2-c6a06f367e67 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 404 len: 111 microversion: 2.1 time: 0.037897 Sep 07 13:41:01.474446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 497/979] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:41:01 2022] DELETE /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:01.478178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:01.478825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 162641ad-da96-482a-bfef-b82281e487b5] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:01.486587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.487177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.487629 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.488375 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.488837 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.489303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.505991 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 HTTP/1.1 Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:01.507606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.509198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '162641ad-da96-482a-bfef-b82281e487b5'} Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:01.510151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. Sep 07 13:41:01.512289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.514360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 162641ad-da96-482a-bfef-b82281e487b5 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:01.514360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5dc99e5d-7e6c-460d-9857-b73e15ef61d0 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5" status: 404 len: 111 microversion: 2.1 time: 0.036315 Sep 07 13:41:01.514360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 483/980] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:01 2022] GET /compute/v2.1/servers/162641ad-da96-482a-bfef-b82281e487b5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:01.519377 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:01.520075 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:01.526584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.532799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.532799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.532799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.532799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.533377 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.548647 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 HTTP/1.1 Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:41:01.550285 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.551926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '4e1621bb-92bb-4e45-8381-6c5759220ab7'} Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:01.553273 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.554868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.556550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:01.556550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-da0845e1-d2ad-4d6d-9b58-ade22e0e7a81 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 404 len: 111 microversion: 2.1 time: 0.036670 Sep 07 13:41:01.556550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 498/981] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:41:01 2022] DELETE /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:01.561749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:01.562384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 4e1621bb-92bb-4e45-8381-6c5759220ab7] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:01.570231 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.570726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.571187 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.571899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.572356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.572777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.597268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 HTTP/1.1 Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:01.599313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.602662 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '4e1621bb-92bb-4e45-8381-6c5759220ab7'} Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:01.604683 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. Sep 07 13:41:01.619206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:01.621420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 4e1621bb-92bb-4e45-8381-6c5759220ab7 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:01.621420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-88a55db6-4996-4a60-a724-de7cddf46c8e tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7" status: 404 len: 111 microversion: 2.1 time: 0.044470 Sep 07 13:41:01.621420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 484/982] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:01 2022] GET /compute/v2.1/servers/4e1621bb-92bb-4e45-8381-6c5759220ab7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:02.081355 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:02.081969 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:02.089039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:02.089689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:02.090124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:02.090886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:02.091443 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:02.091894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:02.271937 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:02.289356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:02.293325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:02.295760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4b97b474-f0cc-4010-b2f7-49dcaa731b65 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1723 microversion: 2.20 time: 0.218058 Sep 07 13:41:02.299388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 499/983] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:41:02 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:41:03.076280 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:03.077064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:03.086207 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.086700 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.087210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.087956 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.088412 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.088843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.103871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: DELETE /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 HTTP/1.1 Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:03.106127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.108873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '9b3f1350-9b24-4671-8770-5bdc7f6921a1'} Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:03.110383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.114501 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.118713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:03.118713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5fbb535e-fd6a-405a-a325-ee752ff2d8b1 tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 404 len: 111 microversion: 2.1 time: 0.037468 Sep 07 13:41:03.118713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 485/984] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:41:03 2022] DELETE /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:03.119293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:03.119293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] [instance: 9b3f1350-9b24-4671-8770-5bdc7f6921a1] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:03.129496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.129942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.130527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.131135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.131613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.132095 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.147840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] HTTP exception thrown: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Request method failure captured: Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 HTTP/1.1 Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2Jkr8cAFMZ0nKNkPK-6Ix6aR57cXsXAovaKZi4mUI3rCMc2oGLj8mETsDu4uYjeHGDm1gyQPY0U4XnJEoa2xNYAfC_jNaNd8hUS1cXqCjVbvkYoY1azBEDt3kEQCl32Pz7jsxF0l7GIhYvcWma8ACB8C7rAWVT9-dT0RDhABKxdU0 Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:41:03.149418 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/495aadbbe15c4f18a5018f45e8bab423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_495aadbbe15c4f18a5018f45e8bab423", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 495aadbbe15c4f18a5018f45e8bab423 Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1622788059 Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: c5e931aa22344990a0f032159ebc20ad Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeNegativeTest-1622788059-project Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.151485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '9b3f1350-9b24-4671-8770-5bdc7f6921a1'} Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:03.153685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. Sep 07 13:41:03.157197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:03.159383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] Returning 404 to user: Instance 9b3f1350-9b24-4671-8770-5bdc7f6921a1 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:03.159383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0f057697-d687-4154-8b10-7b3d7d15c9fd tempest-AttachVolumeNegativeTest-1622788059 tempest-AttachVolumeNegativeTest-1622788059-project] 10.222.0.62 "GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1" status: 404 len: 111 microversion: 2.1 time: 0.038146 Sep 07 13:41:03.159383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 500/985] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:03 2022] GET /compute/v2.1/servers/9b3f1350-9b24-4671-8770-5bdc7f6921a1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:03.330173 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:03.330947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:03.343666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.343666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.343666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.344331 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.345227 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.346168 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.489834 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:03.500470 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:03.502794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:03.504082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-461335d0-be3c-4de9-8e69-635c9fb5e051 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1656 microversion: 2.20 time: 0.181304 Sep 07 13:41:03.504977 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 486/986] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:41:03 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1656 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:41:04.014888 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-90782735-4434-41b5-b694-f1fa8f81fbae req-76112b90-fcba-4d95-a1cf-79920a30227a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561fdee7-7a8f-4e24-98f8-6023d163c251", "name": "network-vif-deleted", "tag": "0d0f70c6-6951-4686-973c-47ad49591ba2"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:04.050666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-90782735-4434-41b5-b694-f1fa8f81fbae req-76112b90-fcba-4d95-a1cf-79920a30227a service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:04.051201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-90782735-4434-41b5-b694-f1fa8f81fbae req-76112b90-fcba-4d95-a1cf-79920a30227a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:04.051841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-90782735-4434-41b5-b694-f1fa8f81fbae req-76112b90-fcba-4d95-a1cf-79920a30227a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:04.088119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-90782735-4434-41b5-b694-f1fa8f81fbae req-76112b90-fcba-4d95-a1cf-79920a30227a service nova] Creating event network-vif-deleted:0d0f70c6-6951-4686-973c-47ad49591ba2 for instance 561fdee7-7a8f-4e24-98f8-6023d163c251 on hv-cinder-85625 Sep 07 13:41:04.101124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-90782735-4434-41b5-b694-f1fa8f81fbae req-76112b90-fcba-4d95-a1cf-79920a30227a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089636 Sep 07 13:41:04.104333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 501/987] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:04.553365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:04.555557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:04.575068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:04.576003 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:04.576827 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:04.578503 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:04.579395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:04.580221 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:04.681454 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:04.682230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:04.683178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:04.684335 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lazy-loading 'fault' on Instance uuid 561fdee7-7a8f-4e24-98f8-6023d163c251 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:41:04.828563 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:04.848825 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:04.852778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32401931d75649018f6b0e55144bb5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a627a9e151e4e8d8522afbc844c550c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:04.856469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e8d967aa-bbad-4fec-a8d0-0c97cbc2ccae tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 200 len: 1371 microversion: 2.20 time: 0.310484 Sep 07 13:41:04.857851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 487/988] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:41:04 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:41:05.891130 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:05.891913 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:05.909757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:05.910272 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:05.910747 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:05.911559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:05.912060 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:05.912495 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:05.950377 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] HTTP exception thrown: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Request method failure captured: Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 HTTP/1.1 Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ2YX19fcJdafG7qjP2JxDFMHv7AVVZgK0Xg9LwrDtukhvCPjDJ64Nb3c-qVhrNgA9UDSlLYR58CbU2kMyfFeOda984TCsfNLAdtIlgtHIfOzJKX81BI__JitCO3LKVRQOkUzyu1vP9E2zV2SSaExQBHFhL51nLFvmfsLyTNUE30s0w Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:41:05.953312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a627a9e151e4e8d8522afbc844c550c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 32401931d75649018f6b0e55144bb5f2 Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:05.954778 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '561fdee7-7a8f-4e24-98f8-6023d163c251'} Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:05.955588 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:05.957567 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:05.958917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Returning 404 to user: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:05.958917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d779e548-860d-420f-8f4c-cf84ad05ce62 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 404 len: 111 microversion: 2.20 time: 0.070349 Sep 07 13:41:05.958917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 502/989] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:41:05 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:41:05.968820 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e7aa4a33-2f4d-4a05-9b88-f5ed3a4cc32b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '.version_select at 0x7f1747bfe5e0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:06.137496 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e7aa4a33-2f4d-4a05-9b88-f5ed3a4cc32b tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785127292" status: 204 len: 0 microversion: 2.20 time: 0.172395 Sep 07 13:41:06.138883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 488/990] 10.222.0.62 () {60 vars in 1262 bytes} [Wed Sep 7 13:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785127292 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:41:11.445062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:11.445977 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:11.454147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.454677 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.455133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.455871 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.456343 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.456770 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.488290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:41:11.748228 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:11.750477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:11.765048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.765626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.766263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.767097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.767623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.768193 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.785425 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] HTTP exception thrown: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Request method failure captured: Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: DELETE /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 HTTP/1.1 Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2YX19fcJdafG7qjP2JxDFMHv7AVVZgK0Xg9LwrDtukhvCPjDJ64Nb3c-qVhrNgA9UDSlLYR58CbU2kMyfFeOda984TCsfNLAdtIlgtHIfOzJKX81BI__JitCO3LKVRQOkUzyu1vP9E2zV2SSaExQBHFhL51nLFvmfsLyTNUE30s0w Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:11.787111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a627a9e151e4e8d8522afbc844c550c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 32401931d75649018f6b0e55144bb5f2 Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.789136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '561fdee7-7a8f-4e24-98f8-6023d163c251'} Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:11.790164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.791663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.798223 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Returning 404 to user: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:11.799710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0b00ebb2-9d6a-4968-bc36-99bf0dcfb667 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 404 len: 111 microversion: 2.20 time: 0.058820 Sep 07 13:41:11.800832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 489/991] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 7 13:41:11 2022] DELETE /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:41:11.812185 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:11.815747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 561fdee7-7a8f-4e24-98f8-6023d163c251] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:11.824768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.826328 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.826940 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.827981 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.828559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.829085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.848582 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] HTTP exception thrown: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Request method failure captured: Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 HTTP/1.1 Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2YX19fcJdafG7qjP2JxDFMHv7AVVZgK0Xg9LwrDtukhvCPjDJ64Nb3c-qVhrNgA9UDSlLYR58CbU2kMyfFeOda984TCsfNLAdtIlgtHIfOzJKX81BI__JitCO3LKVRQOkUzyu1vP9E2zV2SSaExQBHFhL51nLFvmfsLyTNUE30s0w Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:11.850373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a627a9e151e4e8d8522afbc844c550c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 32401931d75649018f6b0e55144bb5f2 Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.852312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '561fdee7-7a8f-4e24-98f8-6023d163c251'} Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:11.853143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. Sep 07 13:41:11.854688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:11.859663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Returning 404 to user: Instance 561fdee7-7a8f-4e24-98f8-6023d163c251 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:11.860994 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6c455912-69bf-4507-bf60-418dcb868ad3 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251" status: 404 len: 111 microversion: 2.20 time: 0.054384 Sep 07 13:41:11.862046 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 490/992] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:41:11 2022] GET /compute/v2.1/servers/561fdee7-7a8f-4e24-98f8-6023d163c251 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:41:12.205186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9be51e9f-138f-4657-87d8-c3de686e5f86 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "DELETE /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 204 len: 0 microversion: 2.1 time: 0.764069 Sep 07 13:41:12.206234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 503/993] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:41:11 2022] DELETE /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 0 bytes in 767 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:41:12.221118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:12.222678 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:12.233846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:12.234741 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:12.236429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:12.236429 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:12.237078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:12.237389 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:12.468354 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:12.492341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-94f746f5-bbae-4747-946b-fb459884e50b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1577 microversion: 2.1 time: 0.274567 Sep 07 13:41:12.492341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 491/994] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:12 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1577 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:13.535992 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:13.537266 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:13.551622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.552314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.552835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:13.553918 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.554478 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.555366 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:13.577473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:13.630935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:13.630935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:13.640782 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.641405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.641865 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:13.642626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.643300 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.643602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:13.647008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:13.662247 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] HTTP exception thrown: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Request method failure captured: Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: DELETE /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 HTTP/1.1 Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2YX19fcJdafG7qjP2JxDFMHv7AVVZgK0Xg9LwrDtukhvCPjDJ64Nb3c-qVhrNgA9UDSlLYR58CbU2kMyfFeOda984TCsfNLAdtIlgtHIfOzJKX81BI__JitCO3LKVRQOkUzyu1vP9E2zV2SSaExQBHFhL51nLFvmfsLyTNUE30s0w Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:13.663913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a627a9e151e4e8d8522afbc844c550c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 32401931d75649018f6b0e55144bb5f2 Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.666502 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '78d77c88-2507-41f1-a8bf-604880929568'} Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:13.672794 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.677807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.683508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Returning 404 to user: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:13.683508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a9cc2f8f-e08b-486d-ade8-d0d3519f23d6 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "DELETE /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 404 len: 111 microversion: 2.20 time: 0.038770 Sep 07 13:41:13.683508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 492/995] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 7 13:41:13 2022] DELETE /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:41:13.683508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:13.683508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] [instance: 78d77c88-2507-41f1-a8bf-604880929568] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:13.700705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.701394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.701854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:13.703063 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.703554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.704023 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:13.733340 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] HTTP exception thrown: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Request method failure captured: Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 HTTP/1.1 Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ2YX19fcJdafG7qjP2JxDFMHv7AVVZgK0Xg9LwrDtukhvCPjDJ64Nb3c-qVhrNgA9UDSlLYR58CbU2kMyfFeOda984TCsfNLAdtIlgtHIfOzJKX81BI__JitCO3LKVRQOkUzyu1vP9E2zV2SSaExQBHFhL51nLFvmfsLyTNUE30s0w Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:13.738877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a627a9e151e4e8d8522afbc844c550c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a627a9e151e4e8d8522afbc844c550c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 6a627a9e151e4e8d8522afbc844c550c Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2008889413 Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 32401931d75649018f6b0e55144bb5f2 Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2008889413-project Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.741565 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '78d77c88-2507-41f1-a8bf-604880929568'} Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:13.742538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. Sep 07 13:41:13.747330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:13.758417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] Returning 404 to user: Instance 78d77c88-2507-41f1-a8bf-604880929568 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:13.758417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6817d723-d52f-462d-bc18-730e579e2d35 tempest-AttachVolumeShelveTestJSON-2008889413 tempest-AttachVolumeShelveTestJSON-2008889413-project] 10.222.0.62 "GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568" status: 404 len: 111 microversion: 2.20 time: 0.063678 Sep 07 13:41:13.758417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 493/996] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 7 13:41:13 2022] GET /compute/v2.1/servers/78d77c88-2507-41f1-a8bf-604880929568 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:41:13.806603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:13.820057 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e042f1c9-4e70-466a-97b6-16aa658f08a0 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1577 microversion: 2.1 time: 0.301070 Sep 07 13:41:13.823043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 504/997] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:13 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1577 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:14.852890 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:14.853985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:14.868209 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:14.869038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:14.869811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:14.872407 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:14.873687 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:14.874349 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.370908 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:15.388846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-056fb531-2aac-45e7-b60f-b3134fccb450 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1577 microversion: 2.1 time: 0.542125 Sep 07 13:41:15.390388 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 494/998] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:14 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1577 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:16.432286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:16.437095 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:16.441515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-68e8b30a-2016-4d2d-98ca-807615c9e227 req-170885a1-1cd1-4da2-b950-f8a1728aa79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628c7746-90a9-47ed-a112-e91e1a62c0aa", "name": "network-vif-deleted", "tag": "9f3289a6-1346-46ed-b353-ce1bdee8b13f"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:16.462764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:16.482463 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:16.483640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:16.490223 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:16.490223 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:16.490223 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:16.490223 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:16.491370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-68e8b30a-2016-4d2d-98ca-807615c9e227 req-170885a1-1cd1-4da2-b950-f8a1728aa79c service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:16.493352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-68e8b30a-2016-4d2d-98ca-807615c9e227 req-170885a1-1cd1-4da2-b950-f8a1728aa79c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:16.494247 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-68e8b30a-2016-4d2d-98ca-807615c9e227 req-170885a1-1cd1-4da2-b950-f8a1728aa79c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:16.518046 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-68e8b30a-2016-4d2d-98ca-807615c9e227 req-170885a1-1cd1-4da2-b950-f8a1728aa79c service nova] Creating event network-vif-deleted:9f3289a6-1346-46ed-b353-ce1bdee8b13f for instance 628c7746-90a9-47ed-a112-e91e1a62c0aa on hv-cinder-85625 Sep 07 13:41:16.545316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-68e8b30a-2016-4d2d-98ca-807615c9e227 req-170885a1-1cd1-4da2-b950-f8a1728aa79c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115357 Sep 07 13:41:16.546225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 495/999] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:16.605757 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:16.629093 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-77902710-01a4-4a18-b19d-4aee759f438c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1510 microversion: 2.1 time: 0.202332 Sep 07 13:41:16.632330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 505/1000] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:16 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:17.662740 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:17.665199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:17.677355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:17.678002 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:17.678684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:17.680822 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:17.681636 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:17.682420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:17.738567 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:17.739140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:17.739629 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:17.740102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lazy-loading 'fault' on Instance uuid 628c7746-90a9-47ed-a112-e91e1a62c0aa {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:41:17.851253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:17.873312 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ca4b3828-c0a0-4214-84c6-075a37501f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 200 len: 1231 microversion: 2.1 time: 0.218383 Sep 07 13:41:17.887785 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 496/1001] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:17 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 1231 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:18.919115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:18.920515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:18.929493 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:18.931518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:18.931518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:18.932064 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:18.933232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:18.934089 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:18.958954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] HTTP exception thrown: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Request method failure captured: Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa HTTP/1.1 Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ6z2McoqgrcY0DeWvCCkVmFDvyLaB1UdYJ4Mz6MneFnCd7dRydRkE9-Kq1K6qH4mBcYeKW1EuPkT0Vo3_dwfXIHWSq2EgobPYuGlIp3znT6j1_R3XOu6OfIrdcmbVZV95I_Auv12X_W5qiN6TFW9esPDnCfPMkdkGCaC0hah_42mBA Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:41:18.960880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b4d5ce9b4fe34fc094bdacc3ca994537", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 9dae215cd92f46d18a3c1b7389c3af4b Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:41:18.964945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '628c7746-90a9-47ed-a112-e91e1a62c0aa'} Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:18.966121 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:41:18.973380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:18.974706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Returning 404 to user: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:18.974706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-060d4d4d-66f8-4e2a-ac0f-3466cdfc28bc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 404 len: 111 microversion: 2.1 time: 0.047927 Sep 07 13:41:18.974706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 506/1002] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:18 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:41:19.116036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-59049980", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1952784259", "security_groups": [{"name": "tempest-secgroup-smoke-308951509"}], "block_device_mapping_v2": [{"uuid": "24cbff4d-a6b0-4eff-add4-ca6601a1f86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96dda948-6c1a-414d-b47c-330985b8eab3"}]}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:19.280075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] validate_networks() for [('96dda948-6c1a-414d-b47c-330985b8eab3', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:41:19.989113 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:41:19.989554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:41:19.990031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:41:19.990445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:41:19.990864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:41:20.007392 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:20.008428 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:20.016643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:20.016643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:20.016643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:20.016643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:20.034197 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:41:20.039616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for user 9dae215cd92f46d18a3c1b7389c3af4b and project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:41:20.155102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:41:20.159713 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24cbff4d-a6b0-4eff-add4-ca6601a1f86d',volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:41:20.969094 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a0f010a9-c380-45d7-bca5-b8080c91bd5c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.854820 Sep 07 13:41:20.976907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 497/1003] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:41:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:41:20.994268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-609f6e3d-0ec6-4f54-80be-b81c31942179 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:20.997094 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-609f6e3d-0ec6-4f54-80be-b81c31942179 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:21.112699 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-609f6e3d-0ec6-4f54-80be-b81c31942179 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:21.124193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-609f6e3d-0ec6-4f54-80be-b81c31942179 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1093 microversion: 2.1 time: 0.142707 Sep 07 13:41:21.146419 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 507/1004] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:20 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1093 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:22.155268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-927315a7-9e9e-4428-8422-4439059c9f13 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:22.156000 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-927315a7-9e9e-4428-8422-4439059c9f13 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:22.158907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:22.243318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-927315a7-9e9e-4428-8422-4439059c9f13 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:22.262255 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-927315a7-9e9e-4428-8422-4439059c9f13 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1093 microversion: 2.1 time: 0.111640 Sep 07 13:41:22.263343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 498/1005] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:22 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1093 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:23.295177 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:23.296283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:23.309681 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.310195 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.310726 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.311503 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.311966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.312394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.413361 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:23.431582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fb03cfb9-7243-4630-9816-71a19f932f4d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1143 microversion: 2.1 time: 0.138442 Sep 07 13:41:23.431582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 508/1006] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:23 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1143 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:24.467279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:24.468668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:24.477039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:24.477992 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:24.478781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:24.480744 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:24.481417 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:24.482114 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:24.571873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:24.585699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a0784115-97f2-4295-9778-c64e5c68d8d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1143 microversion: 2.1 time: 0.124121 Sep 07 13:41:24.586532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 499/1007] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:24 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1143 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:24.746190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-924e9045-45f3-4c1f-aa1e-7e0a83226da9 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Action: 'create', calling method: .version_select at 0x7f174f6394c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2058953242"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:25.627167 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:25.628392 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:25.644773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:25.644773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:25.644773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:25.645314 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:25.645739 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:25.646432 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:25.722204 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:25.734439 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-eb3d56b1-77b1-4bf1-b111-3a656e185517 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1135 microversion: 2.1 time: 0.114399 Sep 07 13:41:25.735974 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 500/1008] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:25 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1135 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:25.804971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-924e9045-45f3-4c1f-aa1e-7e0a83226da9 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.200649 Sep 07 13:41:25.807055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 509/1009] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Sep 7 13:41:24 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1203 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:41:25.825716 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-69be1948-8c2a-422f-a23e-6b9a05c0c159 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747de90d0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:25.907196 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-69be1948-8c2a-422f-a23e-6b9a05c0c159 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 200 len: 345 microversion: 2.1 time: 0.088634 Sep 07 13:41:25.908024 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 501/1010] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:41:25 2022] GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:26.762539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:26.762539 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:26.771298 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:26.771983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:26.772596 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:26.773557 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:26.774129 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:26.774735 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:26.855440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:26.864806 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-85291d39-6d56-46ae-a830-65e1700b1528 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1135 microversion: 2.1 time: 0.108500 Sep 07 13:41:26.865396 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 510/1011] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:26 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1135 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:26.929576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b604f39b-6222-4493-be43-26b5453f1477 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747d809d0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:26.989828 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b604f39b-6222-4493-be43-26b5453f1477 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 200 len: 345 microversion: 2.1 time: 0.069853 Sep 07 13:41:26.990454 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 502/1012] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:41:26 2022] GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:27.894799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:27.895923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:27.908819 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.909686 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.910491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:27.911804 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.912626 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.913536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:28.013483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-485118f9-d70c-4152-859b-30935f659013 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747d80b80>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:28.014451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:28.034026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a8d22fb8-d072-47d8-a82a-e4ccb26099f3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1135 microversion: 2.1 time: 0.147114 Sep 07 13:41:28.035046 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 511/1013] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:27 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1135 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:28.111471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-485118f9-d70c-4152-859b-30935f659013 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 200 len: 345 microversion: 2.1 time: 0.106224 Sep 07 13:41:28.112526 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 503/1014] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:41:28 2022] GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:41:29.061131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:29.061972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:29.071735 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:29.072358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:29.078003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:29.078003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:29.078003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:29.078003 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:29.129687 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-289f2bba-5c34-4222-9cb0-6aea4d7048eb tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747ce5700>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:29.200968 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:29.229038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e65173b7-88ba-4a6f-b1a0-9fc1e3227aa9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1199 microversion: 2.1 time: 0.171609 Sep 07 13:41:29.231110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 512/1015] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:29 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1199 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:29.298675 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-289f2bba-5c34-4222-9cb0-6aea4d7048eb tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 200 len: 346 microversion: 2.1 time: 0.173918 Sep 07 13:41:29.300415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 504/1016] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:41:29 2022] GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:29.327105 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-0183d708-e36f-4c3b-96d6-81169284b08c tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Action: 'create', calling method: .version_select at 0x7f174f6f7940>, body: {"snapshot": {"volume_id": "867cfafd-2b3d-4f20-8f44-aa749ef69273", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-697971849"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:30.269640 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:30.277750 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:30.278743 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:30.291839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-0183d708-e36f-4c3b-96d6-81169284b08c tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.972370 Sep 07 13:41:30.303378 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 513/1017] 10.222.0.62 () {60 vars in 1162 bytes} [Wed Sep 7 13:41:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:30.304041 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:30.304041 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:30.304041 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:30.304041 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:30.304594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:30.304594 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:30.316622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2b0d4efc-5ccc-47d6-a556-825ad38d7d6e tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f6398b0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:30.427613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2b0d4efc-5ccc-47d6-a556-825ad38d7d6e tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 200 len: 286 microversion: 2.1 time: 0.117040 Sep 07 13:41:30.431790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 514/1018] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:30 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:30.453009 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fe9dd8b4-79b8-4cf4-a32c-b67076da0bc4 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f69a820>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:30.695118 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fe9dd8b4-79b8-4cf4-a32c-b67076da0bc4 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.250986 Sep 07 13:41:30.696499 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 515/1019] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Sep 7 13:41:30 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:30.722441 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8bd1aa91-c21b-4fd7-aaef-933fd23bc500 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f6e1af0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:30.739127 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:30.770967 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f275dc43-8ee4-41b2-bf43-aa62d41769ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1276 microversion: 2.1 time: 0.502153 Sep 07 13:41:30.771787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 505/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:30 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1276 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:31.117508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:31.470283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8bd1aa91-c21b-4fd7-aaef-933fd23bc500 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 200 len: 286 microversion: 2.1 time: 0.756660 Sep 07 13:41:31.471832 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 516/1021] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:30 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 286 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:41:31.811587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:31.812634 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:31.819747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:31.820241 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:31.820684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:31.821398 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:31.821856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:31.822279 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:32.017034 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:32.026464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cb016580-a9cd-4382-900d-0a9410c81df9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1276 microversion: 2.1 time: 0.219563 Sep 07 13:41:32.027372 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 506/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:31 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:32.488215 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-826ce2e4-7861-47fd-a34f-87057d1e5e6d tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f69a5e0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:32.788290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-826ce2e4-7861-47fd-a34f-87057d1e5e6d tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 200 len: 286 microversion: 2.1 time: 0.304766 Sep 07 13:41:32.788790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 517/1023] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:32 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 286 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:33.051913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:33.053011 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:33.054849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=8 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:33.062469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:33.063027 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:33.063458 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:33.064185 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:33.064648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:33.065075 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:33.232014 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:33.240487 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-cc916d5a-87e8-4f6f-9e97-7f41582027aa tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1276 microversion: 2.1 time: 0.193051 Sep 07 13:41:33.241074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 507/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:33 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:33.805977 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-16cc3f5d-b174-4878-924d-3d639940db4b tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f6963a0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:33.848699 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-16cc3f5d-b174-4878-924d-3d639940db4b tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 200 len: 287 microversion: 2.1 time: 0.047623 Sep 07 13:41:33.849753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 518/1025] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:33 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:33.878608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5315c069-1cf7-4d7d-a2a2-ccf6c2522212 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747bfe430>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:34.123957 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5315c069-1cf7-4d7d-a2a2-ccf6c2522212 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 202 len: 0 microversion: 2.1 time: 0.259688 Sep 07 13:41:34.130012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 508/1026] 10.222.0.62 () {58 vars in 1254 bytes} [Wed Sep 7 13:41:33 2022] DELETE /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:41:34.140468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b6c59403-cf33-45d8-9fa4-dcc8e686cd58 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f69a670>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:34.274403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:34.276370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:34.286759 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:34.288009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:34.288720 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:34.289729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:34.290320 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:34.290821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:34.306360 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b6c59403-cf33-45d8-9fa4-dcc8e686cd58 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 200 len: 286 microversion: 2.1 time: 0.174764 Sep 07 13:41:34.308245 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 519/1027] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:34 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:34.655491 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:34.668864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-745a23ca-6f74-490e-82ff-543bc6b83e40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1276 microversion: 2.1 time: 0.400296 Sep 07 13:41:34.669694 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 509/1028] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:34 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1276 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:34.774948 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-3f66cb3b-d720-4508-875b-b71f913b3da3 req-93b6c696-1041-4350-9d58-e112699bec44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41d2be4-ca91-4189-9b6e-c36b1ed6638b", "tag": "03490dab-650b-4910-8afd-c09a150bf2c5"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:34.795706 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-3f66cb3b-d720-4508-875b-b71f913b3da3 req-93b6c696-1041-4350-9d58-e112699bec44 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:34.796584 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-3f66cb3b-d720-4508-875b-b71f913b3da3 req-93b6c696-1041-4350-9d58-e112699bec44 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:34.797369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-3f66cb3b-d720-4508-875b-b71f913b3da3 req-93b6c696-1041-4350-9d58-e112699bec44 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:34.820427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-3f66cb3b-d720-4508-875b-b71f913b3da3 req-93b6c696-1041-4350-9d58-e112699bec44 service nova] Creating event network-changed:03490dab-650b-4910-8afd-c09a150bf2c5 for instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b on hv-cinder-85625 Sep 07 13:41:34.829983 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-3f66cb3b-d720-4508-875b-b71f913b3da3 req-93b6c696-1041-4350-9d58-e112699bec44 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060093 Sep 07 13:41:34.831388 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 520/1029] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:35.328598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d28e4289-70d0-4b35-b776-2fa984df3c22 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747e025e0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:35.403632 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d28e4289-70d0-4b35-b776-2fa984df3c22 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 200 len: 286 microversion: 2.1 time: 0.082510 Sep 07 13:41:35.404326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 510/1030] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:35 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:41:35.700709 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:35.701582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:35.711197 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:35.711710 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:35.712229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:35.713205 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:35.713800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:35.714312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:35.952718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:35.967071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a14c2ea5-6315-4cf5-a0b0-751716181a40 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1276 microversion: 2.1 time: 0.272104 Sep 07 13:41:35.968226 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 521/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:35 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:36.428841 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c65ad69d-3872-4ce9-8a63-f68430d54fd6 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747c111f0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:36.566169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c65ad69d-3872-4ce9-8a63-f68430d54fd6 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 200 len: 286 microversion: 2.1 time: 0.139761 Sep 07 13:41:36.566169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 511/1032] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:36 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:37.008865 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:37.011122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:37.024826 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:37.025839 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:37.026957 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:37.028518 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:37.029079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:37.029847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:37.435873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:37.453358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-33c14b1d-abef-47e6-8cad-ea94e3ba4785 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1276 microversion: 2.1 time: 0.452666 Sep 07 13:41:37.454464 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 522/1033] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:36 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1276 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:37.586843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f710a621-080a-440f-9622-e59bafea2405 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747c8e280>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:37.699648 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-f710a621-080a-440f-9622-e59bafea2405 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] HTTP exception thrown: Snapshot 1369556d-67ab-4b87-9068-b42907c21989 could not be found. Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f710a621-080a-440f-9622-e59bafea2405 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Request method failure captured: Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 HTTP/1.1 Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ-EpdD0J0e2J4qdui24aVYuhex1e48b8FdnNMPpb9ljlqZ0wmROSfTxgsCO7yjT6xJVa21ZXk-jrORa8rLoTtllL1UXr8v7hLqgNkyddrBI6akDy_xTz4Z0dtiqiN_nuCvejkItUsnHMK2qYlYDb5AQ4XsJH_K6hAIJOlgxo4wcy30 Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:37.705218 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_09755c2e669e40aeb5115662efa0a2e5", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 1b1864fe53964be88612f99c8b26b772 Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Snapshot 1369556d-67ab-4b87-9068-b42907c21989 could not be found. Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '1369556d-67ab-4b87-9068-b42907c21989'} Sep 07 13:41:37.707291 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1369556d-67ab-4b87-9068-b42907c21989 could not be found. (HTTP 404) (Request-ID: req-eb1d0a67-f4ed-4c71-a33b-c804acf90b3d) Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:37.709164 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:41:37.710846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1369556d-67ab-4b87-9068-b42907c21989 could not be found. Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 13:41:37.712777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1369556d-67ab-4b87-9068-b42907c21989 could not be found. Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1369556d-67ab-4b87-9068-b42907c21989 could not be found. Sep 07 13:41:37.716365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:37.717330 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f710a621-080a-440f-9622-e59bafea2405 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Returning 404 to user: Snapshot 1369556d-67ab-4b87-9068-b42907c21989 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:37.719934 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f710a621-080a-440f-9622-e59bafea2405 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989" status: 404 len: 111 microversion: 2.1 time: 0.143715 Sep 07 13:41:37.721039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 512/1034] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:41:37 2022] GET /compute/v2.1/os-snapshots/1369556d-67ab-4b87-9068-b42907c21989 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:37.742381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e053bf5d-165e-4371-9c8e-ab0ecdd8d045 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f6968b0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:38.046264 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e053bf5d-165e-4371-9c8e-ab0ecdd8d045 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 202 len: 0 microversion: 2.1 time: 0.309021 Sep 07 13:41:38.051648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 523/1035] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:41:37 2022] DELETE /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:41:38.059849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-26a45e90-848c-49c6-8b7b-f2895ef54346 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747dccaf0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:38.357829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-26a45e90-848c-49c6-8b7b-f2895ef54346 tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 200 len: 345 microversion: 2.1 time: 0.304082 Sep 07 13:41:38.359411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 513/1036] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:41:38 2022] GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 345 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:38.491981 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:38.493134 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:38.505212 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:38.506086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:38.507078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:38.508455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:38.509381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:38.511601 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:38.752726 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:38.767644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-00493055-476d-4731-a06e-7b3fd2b02234 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1276 microversion: 2.1 time: 0.283446 Sep 07 13:41:38.768685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 524/1037] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:38 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1276 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:39.391093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6417776a-b91b-4af5-b0c5-ea937dcae7dc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747e02af0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:39.443769 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-6417776a-b91b-4af5-b0c5-ea937dcae7dc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] HTTP exception thrown: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6417776a-b91b-4af5-b0c5-ea937dcae7dc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Request method failure captured: Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 HTTP/1.1 Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ-EpdD0J0e2J4qdui24aVYuhex1e48b8FdnNMPpb9ljlqZ0wmROSfTxgsCO7yjT6xJVa21ZXk-jrORa8rLoTtllL1UXr8v7hLqgNkyddrBI6akDy_xTz4Z0dtiqiN_nuCvejkItUsnHMK2qYlYDb5AQ4XsJH_K6hAIJOlgxo4wcy30 Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:39.446222 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_09755c2e669e40aeb5115662efa0a2e5", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 1b1864fe53964be88612f99c8b26b772 Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '867cfafd-2b3d-4f20-8f44-aa749ef69273'} Sep 07 13:41:39.451879 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. (HTTP 404) (Request-ID: req-586a29c3-5816-4f3f-9dd6-cee3b9a3ead3) Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.453504 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:41:39.455815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:41:39.457309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6417776a-b91b-4af5-b0c5-ea937dcae7dc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Returning 404 to user: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6417776a-b91b-4af5-b0c5-ea937dcae7dc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 404 len: 109 microversion: 2.1 time: 0.064415 Sep 07 13:41:39.459018 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 514/1038] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:41:39 2022] GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:39.471926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7a9c20e0-bd00-474b-a24b-bb8be0bdfedc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f174f6961f0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:39.514907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-7a9c20e0-bd00-474b-a24b-bb8be0bdfedc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] HTTP exception thrown: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7a9c20e0-bd00-474b-a24b-bb8be0bdfedc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Request method failure captured: Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 HTTP/1.1 Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ-EpdD0J0e2J4qdui24aVYuhex1e48b8FdnNMPpb9ljlqZ0wmROSfTxgsCO7yjT6xJVa21ZXk-jrORa8rLoTtllL1UXr8v7hLqgNkyddrBI6akDy_xTz4Z0dtiqiN_nuCvejkItUsnHMK2qYlYDb5AQ4XsJH_K6hAIJOlgxo4wcy30 Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:41:39.517122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_09755c2e669e40aeb5115662efa0a2e5", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 1b1864fe53964be88612f99c8b26b772 Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '867cfafd-2b3d-4f20-8f44-aa749ef69273'} Sep 07 13:41:39.520087 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. (HTTP 404) (Request-ID: req-7c6988f0-b95e-4a5e-b235-fc8d86ab049a) Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.521949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:41:39.524834 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:41:39.528370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7a9c20e0-bd00-474b-a24b-bb8be0bdfedc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Returning 404 to user: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:39.530883 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7a9c20e0-bd00-474b-a24b-bb8be0bdfedc tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 404 len: 109 microversion: 2.1 time: 0.053676 Sep 07 13:41:39.532984 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 525/1039] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 7 13:41:39 2022] DELETE /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:39.533449 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bec3168a-7fe6-4ecc-8ba8-55bb758576db tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Calling method '.version_select at 0x7f1747d80ca0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:39.571728 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-bec3168a-7fe6-4ecc-8ba8-55bb758576db tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] HTTP exception thrown: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bec3168a-7fe6-4ecc-8ba8-55bb758576db tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Request method failure captured: Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 HTTP/1.1 Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ-EpdD0J0e2J4qdui24aVYuhex1e48b8FdnNMPpb9ljlqZ0wmROSfTxgsCO7yjT6xJVa21ZXk-jrORa8rLoTtllL1UXr8v7hLqgNkyddrBI6akDy_xTz4Z0dtiqiN_nuCvejkItUsnHMK2qYlYDb5AQ4XsJH_K6hAIJOlgxo4wcy30 Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:41:39.574495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/09755c2e669e40aeb5115662efa0a2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_09755c2e669e40aeb5115662efa0a2e5", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: 09755c2e669e40aeb5115662efa0a2e5 Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2027831381 Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 1b1864fe53964be88612f99c8b26b772 Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2027831381-project Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '867cfafd-2b3d-4f20-8f44-aa749ef69273'} Sep 07 13:41:39.576775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. (HTTP 404) (Request-ID: req-aea2b7d7-4852-4257-90d2-85a8c7ac10a2) Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.577641 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:41:39.580363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:41:39.583253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bec3168a-7fe6-4ecc-8ba8-55bb758576db tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] Returning 404 to user: Volume 867cfafd-2b3d-4f20-8f44-aa749ef69273 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bec3168a-7fe6-4ecc-8ba8-55bb758576db tempest-VolumesSnapshotsTestJSON-2027831381 tempest-VolumesSnapshotsTestJSON-2027831381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273" status: 404 len: 109 microversion: 2.1 time: 0.051542 Sep 07 13:41:39.585500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 515/1040] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 7 13:41:39 2022] GET /compute/v2.1/os-volumes/867cfafd-2b3d-4f20-8f44-aa749ef69273 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:41:39.811108 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:39.813438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:39.825194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:39.826091 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:39.826903 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:39.828294 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:39.829257 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:39.830055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:40.036660 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:40.050048 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-913b2fc8-9615-4cea-8494-ed7070656c97 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.246658 Sep 07 13:41:40.051265 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 526/1041] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:39 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:41.095848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:41.095848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:41.105768 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:41.106585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:41.107338 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:41.108294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:41.108829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:41.109497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:41.360168 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:41.374804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8bdeaef5-42d7-405c-b64c-c35f5a9bb3ac tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.291283 Sep 07 13:41:41.375980 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 516/1042] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:41 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:42.417283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:42.419101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:42.427200 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:42.427798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:42.428275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:42.429209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:42.429695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:42.430131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:42.672002 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:42.691898 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9a7f99b2-c050-4ec9-ad4c-18d66cb76eb3 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.282163 Sep 07 13:41:42.693411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 527/1043] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:42 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:43.723882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:43.724892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:43.733258 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:43.733749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:43.734276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:43.735032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:43.735548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:43.736042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:43.984459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:43.994588 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e34d1742-b2d0-4036-b4c1-7119ba7d8cc8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.274530 Sep 07 13:41:43.995528 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 517/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:43 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:45.025827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:45.027316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:45.038467 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:45.039645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:45.040381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:45.042243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:45.043257 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:45.044056 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:45.272520 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:45.287759 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-49988b1b-f070-4d73-9c1d-459682ea6f4c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.268761 Sep 07 13:41:45.289067 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 528/1045] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:45 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:46.335507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:46.336375 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:46.346280 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:46.347136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:46.347815 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:46.348790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:46.349807 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:46.350444 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:46.587051 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:46.590433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=74 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:46.599016 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3c23187a-5f87-4531-8703-71f57d89b30b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.267657 Sep 07 13:41:46.600082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 518/1046] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:46 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:47.640848 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:47.641795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:47.650792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:47.651327 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:47.651784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:47.652528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:47.652993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:47.653425 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:47.887508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:47.912136 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b1990e5f-b0e1-42cf-b05d-bb1d7b1bea80 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.274483 Sep 07 13:41:47.914487 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 529/1047] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:47 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:48.941557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:48.942185 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:48.951226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:48.951734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:48.952183 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:48.952910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:48.953373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:48.953810 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:49.192005 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:49.208393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-77c34b5a-24e8-489d-ae88-a7339f0dd743 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.271019 Sep 07 13:41:49.209508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 519/1048] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:48 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:50.255837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:50.262548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:50.271382 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:50.272281 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:50.273046 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:50.274356 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:50.275280 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:50.276026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:50.285032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=82 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:50.525795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:50.538194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c02e08dd-1087-4d03-b1bb-83b4cbec1863 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.292339 Sep 07 13:41:50.540146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 530/1049] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:50 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:51.589151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:51.590359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:51.605912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:51.607379 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:51.608215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:51.609706 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:51.610601 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:51.611714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:51.884848 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:51.900304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f41c5d39-d3e7-48bf-ac05-12878b82775b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.321861 Sep 07 13:41:51.901058 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 520/1050] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:51 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:52.944860 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:52.946000 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:52.959470 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:52.960320 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:52.961049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:52.962313 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:52.963241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:52.964015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:53.183585 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:53.193522 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-834e9b42-52d2-4d21-8097-b9c9e2a8dcfc tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.255776 Sep 07 13:41:53.194371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 531/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:52 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:54.229216 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:54.230274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:54.241699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:54.242350 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:54.243690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:54.245244 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:54.246356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:54.247093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:54.255438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-f7a4073c-bc78-4035-9704-1b26d610e2cf req-4367e508-a6aa-4f7f-b970-5e2e33ee28eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41d2be4-ca91-4189-9b6e-c36b1ed6638b", "name": "network-vif-plugged", "status": "completed", "tag": "03490dab-650b-4910-8afd-c09a150bf2c5"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:54.266580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=36 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:54.277304 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-f7a4073c-bc78-4035-9704-1b26d610e2cf req-4367e508-a6aa-4f7f-b970-5e2e33ee28eb service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:54.278383 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-f7a4073c-bc78-4035-9704-1b26d610e2cf req-4367e508-a6aa-4f7f-b970-5e2e33ee28eb service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:54.279784 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-f7a4073c-bc78-4035-9704-1b26d610e2cf req-4367e508-a6aa-4f7f-b970-5e2e33ee28eb service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:54.303207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-f7a4073c-bc78-4035-9704-1b26d610e2cf req-4367e508-a6aa-4f7f-b970-5e2e33ee28eb service nova] Creating event network-vif-plugged:03490dab-650b-4910-8afd-c09a150bf2c5 for instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b on hv-cinder-85625 Sep 07 13:41:54.312485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-f7a4073c-bc78-4035-9704-1b26d610e2cf req-4367e508-a6aa-4f7f-b970-5e2e33ee28eb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063185 Sep 07 13:41:54.313551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 532/1052] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:41:54.459172 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:54.471948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8140a943-5d86-4edd-8ed1-ab78df4c91b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.249203 Sep 07 13:41:54.480139 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 521/1053] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:54 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:55.510304 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:55.511636 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:55.521662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:55.522412 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:55.523075 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:55.524011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:55.524655 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:55.526415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:55.753354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:55.762795 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8014479d-5413-49d9-a790-68d63cd15ec9 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.261699 Sep 07 13:41:55.763457 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 533/1054] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:55 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:56.792977 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:56.793873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:56.801537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:56.802198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:56.802733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:56.803593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:56.804115 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:56.804637 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:57.000446 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:57.015626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-eefe07b3-c7d9-4a3a-8ab0-8947367ae454 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.226768 Sep 07 13:41:57.016670 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 522/1055] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:56 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:58.060542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:58.062394 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:58.075491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:58.076560 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:58.077528 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:58.079632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:58.080782 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:58.081600 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:58.330028 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:58.349343 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b34ed606-92b3-4f3a-91e3-b312d3b157ba tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1264 microversion: 2.1 time: 0.297655 Sep 07 13:41:58.350489 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 534/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:58 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1264 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:59.403201 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:59.404254 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:59.411014 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=30 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:59.417637 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:59.418135 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:59.418610 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:59.419511 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:59.420239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:59.420835 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:59.675870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:59.692826 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0b6fe371-06f8-4856-94a5-839547f4bf99 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1451 microversion: 2.1 time: 0.296691 Sep 07 13:41:59.693893 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 523/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:59 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1451 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:59.730642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:59.731847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:59.745732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:59.746613 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:59.747263 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:59.748562 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:59.749412 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:59.750181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:00.025145 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:00.041249 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-da100951-d98e-4cc4-bba5-9f906b952bb1 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1451 microversion: 2.1 time: 0.317703 Sep 07 13:42:00.042319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 535/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:59 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1451 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:04.000380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-9ed2fd11-d547-4655-9691-5c20465ae162 req-6ad23213-3a10-4b67-bc03-3beb0d0b4c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41d2be4-ca91-4189-9b6e-c36b1ed6638b", "tag": "03490dab-650b-4910-8afd-c09a150bf2c5"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:42:04.014426 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-9ed2fd11-d547-4655-9691-5c20465ae162 req-6ad23213-3a10-4b67-bc03-3beb0d0b4c45 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:04.015247 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-9ed2fd11-d547-4655-9691-5c20465ae162 req-6ad23213-3a10-4b67-bc03-3beb0d0b4c45 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:04.016448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-9ed2fd11-d547-4655-9691-5c20465ae162 req-6ad23213-3a10-4b67-bc03-3beb0d0b4c45 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:04.044544 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-9ed2fd11-d547-4655-9691-5c20465ae162 req-6ad23213-3a10-4b67-bc03-3beb0d0b4c45 service nova] Creating event network-changed:03490dab-650b-4910-8afd-c09a150bf2c5 for instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b on hv-cinder-85625 Sep 07 13:42:04.051653 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-9ed2fd11-d547-4655-9691-5c20465ae162 req-6ad23213-3a10-4b67-bc03-3beb0d0b4c45 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058461 Sep 07 13:42:04.052698 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 524/1059] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:21.547627 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:43:21.548242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Wed Sep 7 13:43:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Sep 07 13:43:21.549426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=7 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:21.550561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=31 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:21.558644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1697209984", "imageRef": "79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a", "flavorRef": "452"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:22.020479 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] validate_networks() for None {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:43:22.414899 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:43:22.415409 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:43:22.415920 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:43:22.416362 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:43:22.416780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:43:22.426130 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:22.426622 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:22.427088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:22.427821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:22.429074 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:22.429505 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:22.446156 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Getting quotas for project 4e8407f7ed3645e2a15d5f9f08b43e0d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:43:22.450077 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Getting quotas for user 9d4eaa0c623240fa8e61d9aad069d7c9 and project 4e8407f7ed3645e2a15d5f9f08b43e0d. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:43:22.461027 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:43:22.463338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79b062ad-c9b3-4b8e-82ce-35f50d3d1e2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:43:22.614753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f52aef63-2118-47fc-bace-0e7e30404dc1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073019 Sep 07 13:43:22.615789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 536/1060] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:43:22.633159 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=3 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:22.633915 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=33 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:22.638784 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a35bfa98-e624-4a91-8925-7b4d6c3ff460 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:22.639998 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a35bfa98-e624-4a91-8925-7b4d6c3ff460 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:22.824812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3d6e2a4e-b6f2-4058-b209-61c9b42d2c5c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Action: 'create', calling method: .version_select at 0x7f1747d3e9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-127697865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+TTzzfm5lKSdqs6NQSxSiJoFLAtye95GINSEonn0YdXmjuclPGSJdTIsav+H+tnfrlVA/lkZuKiCgPIWv1vmY49qrAtYgSfnFq4Ytc27OsI3mwe8gwXpCj3TAeFFsaZA=="}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:22.847786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3d6e2a4e-b6f2-4058-b209-61c9b42d2c5c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Getting quotas for project b933078b01aa4e3b82e37fef9b6ff92c. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:43:22.854485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-3d6e2a4e-b6f2-4058-b209-61c9b42d2c5c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Getting quotas for user 8895cee0f4444866bd4c3908eb248543 and project b933078b01aa4e3b82e37fef9b6ff92c. Resources: {'key_pairs'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:43:22.981120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3d6e2a4e-b6f2-4058-b209-61c9b42d2c5c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.160540 Sep 07 13:43:22.985382 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 537/1061] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:43:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:43:23.122326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-114265528", "imageRef": "07f57a10-3070-4653-8edd-214f6b4c646f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-127697865", "networks": [{"uuid": "17d79c2d-0841-4654-b2f9-c57a6c931fd8"}]}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:23.136913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a35bfa98-e624-4a91-8925-7b4d6c3ff460 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:23.145705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a35bfa98-e624-4a91-8925-7b4d6c3ff460 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1215 microversion: 2.1 time: 0.521137 Sep 07 13:43:23.145705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 525/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:22 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1215 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:23.181337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] validate_networks() for [('17d79c2d-0841-4654-b2f9-c57a6c931fd8', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:43:23.610726 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:43:23.611325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:43:23.611973 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:43:23.612415 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:43:23.613036 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:43:23.624417 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:23.625101 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:23.625384 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:23.626290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:23.626645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:23.627284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:23.645402 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Getting quotas for project b933078b01aa4e3b82e37fef9b6ff92c. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:43:23.649548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Getting quotas for user 8895cee0f4444866bd4c3908eb248543 and project b933078b01aa4e3b82e37fef9b6ff92c. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:43:23.660965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:43:23.663249 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07f57a10-3070-4653-8edd-214f6b4c646f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:43:23.945620 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6a1bdc92-4298-4909-a9fa-e0e267cecf43 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828106 Sep 07 13:43:23.946809 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 538/1063] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:43:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:43:23.959310 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-23b292c6-f5c0-4665-b9dc-6db8d7094732 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:23.959981 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-23b292c6-f5c0-4665-b9dc-6db8d7094732 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:24.020326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-23b292c6-f5c0-4665-b9dc-6db8d7094732 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:24.029870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-23b292c6-f5c0-4665-b9dc-6db8d7094732 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1257 microversion: 2.1 time: 0.075527 Sep 07 13:43:24.030821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 526/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:23 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1257 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:24.169198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-69a2202f-6120-437d-9986-489e4c829f10 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:24.169963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-69a2202f-6120-437d-9986-489e4c829f10 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:24.226137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-69a2202f-6120-437d-9986-489e4c829f10 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:24.234147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-69a2202f-6120-437d-9986-489e4c829f10 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1215 microversion: 2.1 time: 0.069068 Sep 07 13:43:24.234999 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 539/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:24 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:25.057684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8a6090f5-af9e-4c95-9562-19cf8e43cbbc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:25.059123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8a6090f5-af9e-4c95-9562-19cf8e43cbbc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:25.141306 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8a6090f5-af9e-4c95-9562-19cf8e43cbbc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:25.150118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8a6090f5-af9e-4c95-9562-19cf8e43cbbc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1257 microversion: 2.1 time: 0.100151 Sep 07 13:43:25.150724 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 527/1066] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:25 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1257 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:25.259175 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:25.259993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:25.266923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:25.273156 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:25.273156 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:25.273156 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:25.273156 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:25.275759 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:25.347708 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:25.357594 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-371a9087-3d7a-49dd-a78d-6ef49389595d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1267 microversion: 2.1 time: 0.103255 Sep 07 13:43:25.358169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 540/1067] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:25 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:26.174558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:26.175226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:26.183847 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:26.184305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:26.184707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:26.185404 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:26.185853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:26.186276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:26.251781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:26.260379 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9252fa40-2a01-48bc-a96e-7bd97fc7f480 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1261 microversion: 2.1 time: 0.089664 Sep 07 13:43:26.261262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 528/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:26 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:26.382668 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:26.383408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:26.390117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:26.392127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:26.392127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:26.392127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:26.392439 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:26.392700 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:26.467016 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:26.476532 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6d6953cc-157a-4f99-8faa-6c4a1d8bc11c tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1275 microversion: 2.1 time: 0.097710 Sep 07 13:43:26.491004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 541/1069] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:26 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:27.284201 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:27.284821 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:27.291918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:27.292420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:27.292854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:27.293550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:27.294080 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:27.294524 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:27.401069 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:27.409278 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-eb234dca-2b10-4c5f-bf24-d9e40d8ae760 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1309 microversion: 2.1 time: 0.129148 Sep 07 13:43:27.409905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 529/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:27 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:27.508068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:27.509222 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:27.517181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:27.517679 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:27.518148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:27.518870 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:27.519358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:27.519777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:27.618083 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:27.633050 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e7619b6f-9186-4f91-add5-ec0ce32cb4f0 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1273 microversion: 2.1 time: 0.131983 Sep 07 13:43:27.634395 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 542/1071] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:27 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1273 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:28.437479 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:28.439004 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:28.447042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:28.447812 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:28.449263 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:28.450268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:28.450860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:28.451479 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:28.553941 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:28.561734 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-990a3d57-4722-4022-898c-d0a7d4356852 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1315 microversion: 2.1 time: 0.130303 Sep 07 13:43:28.562316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 530/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:28 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1315 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:28.659426 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:28.660408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:28.669904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:28.670401 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:28.670836 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:28.671972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:28.672617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:28.673055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:28.911673 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:28.924332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-47c57f1d-4edb-45dd-8b44-cc16765dd825 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.270324 Sep 07 13:43:28.925365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 543/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:28 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:29.314757 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-1f683c76-e156-4bba-83cd-8bfa4e6df74b req-923fafca-721f-406a-b459-8ec5d6b3bc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbec643b-c358-45bb-b883-bb17aed2675c", "tag": "76d34968-4f9c-4def-9047-acba7513944e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:29.366362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-1f683c76-e156-4bba-83cd-8bfa4e6df74b req-923fafca-721f-406a-b459-8ec5d6b3bc3a service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:29.367647 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-1f683c76-e156-4bba-83cd-8bfa4e6df74b req-923fafca-721f-406a-b459-8ec5d6b3bc3a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:29.368930 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-1f683c76-e156-4bba-83cd-8bfa4e6df74b req-923fafca-721f-406a-b459-8ec5d6b3bc3a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:29.400105 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-1f683c76-e156-4bba-83cd-8bfa4e6df74b req-923fafca-721f-406a-b459-8ec5d6b3bc3a service nova] Creating event network-changed:76d34968-4f9c-4def-9047-acba7513944e for instance dbec643b-c358-45bb-b883-bb17aed2675c on hv-cinder-85625 Sep 07 13:43:29.409949 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-1f683c76-e156-4bba-83cd-8bfa4e6df74b req-923fafca-721f-406a-b459-8ec5d6b3bc3a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106295 Sep 07 13:43:29.411399 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 531/1074] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:29.591078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:29.592038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:29.599404 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:29.600284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:29.600718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:29.601442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:29.601978 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:29.602399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:29.797099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:29.808737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b11a2666-0ee4-4414-bf59-f511557a4fa1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.222782 Sep 07 13:43:29.809645 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 544/1075] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:29 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:29.952990 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:29.954533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:29.962628 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:29.963305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:29.963849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:29.964673 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:29.965304 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:29.965836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:30.205959 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:30.218506 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-627d9d0f-9c4f-4571-8e47-631f3b4a21d1 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.269747 Sep 07 13:43:30.219546 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 532/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:29 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:30.456799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-8cfee131-c989-4ed4-98e8-75a46b0bca53 req-30d6929d-cf7b-40c0-bf7c-0262f34b56b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86", "tag": "50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:30.477601 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8cfee131-c989-4ed4-98e8-75a46b0bca53 req-30d6929d-cf7b-40c0-bf7c-0262f34b56b3 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:30.482961 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8cfee131-c989-4ed4-98e8-75a46b0bca53 req-30d6929d-cf7b-40c0-bf7c-0262f34b56b3 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:30.482961 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8cfee131-c989-4ed4-98e8-75a46b0bca53 req-30d6929d-cf7b-40c0-bf7c-0262f34b56b3 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:30.502662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-8cfee131-c989-4ed4-98e8-75a46b0bca53 req-30d6929d-cf7b-40c0-bf7c-0262f34b56b3 service nova] Creating event network-changed:50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e for instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 on hv-cinder-85625 Sep 07 13:43:30.510642 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-8cfee131-c989-4ed4-98e8-75a46b0bca53 req-30d6929d-cf7b-40c0-bf7c-0262f34b56b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057143 Sep 07 13:43:30.512010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 545/1077] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:30.839182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:30.840384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:30.848671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:30.850677 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:30.851769 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:30.852909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:30.853608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:30.854316 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:31.033269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:31.043626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-aa9b9929-8c49-4f70-8bed-b339d4d45eb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.209876 Sep 07 13:43:31.044619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 533/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:30 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:31.249952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:31.251548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:31.259153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:31.259956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:31.260595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:31.261315 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:31.261790 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:31.262217 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:31.449461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:31.461062 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4c2d290b-0e86-439e-8141-c9573149b893 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.215896 Sep 07 13:43:31.480453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 546/1079] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:31 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:32.073083 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:32.074442 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:32.082649 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.083161 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.083614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.085160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.085651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.086297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.275760 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:32.285459 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-542fd539-3aad-4d12-8b50-9dd07b2dee47 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.218409 Sep 07 13:43:32.286066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 534/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:32 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:32.487091 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:32.487988 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:32.498090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.498891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.499598 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.500779 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.501837 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.502952 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.678673 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:32.713451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b8ec1f7a-09f4-4901-a373-4e3fa13274bf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.230949 Sep 07 13:43:32.717672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 547/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:32 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:33.312973 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:33.313575 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:33.321661 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:33.322152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:33.322623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:33.323354 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:33.323806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:33.324230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:33.499498 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:33.508446 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-16baf612-0b89-44bf-b59f-5ee433c1c1fa tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.199182 Sep 07 13:43:33.519352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 535/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:33 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:33.739510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:33.742612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:33.749748 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=4 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:33.751809 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:33.752577 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:33.753252 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:33.754204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:33.755033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:33.756354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:33.985664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:33.998031 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-d70e330b-4e47-4ce8-b832-0ed3c7ab4cfc tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.262345 Sep 07 13:43:34.005071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 548/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:33 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:34.537495 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:34.538157 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:34.546154 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:34.546743 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:34.547977 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:34.549110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:34.550205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:34.551515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:34.770845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:34.799525 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1552af31-e8b5-45a6-a830-8c0b82ace40b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.267706 Sep 07 13:43:34.801399 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 536/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:34 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:35.024086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:35.024942 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:35.027030 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=18 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:35.033875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:35.037827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:35.037827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:35.037827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:35.037827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:35.038299 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:35.230109 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:35.243162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-603e9266-72ae-463e-b4e5-0ec573b513d5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.222980 Sep 07 13:43:35.244088 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 549/1085] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:35 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:35.847423 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:35.851710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:35.856968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=6 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:35.864900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:35.866397 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:35.867603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:35.868883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:35.869642 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:35.870461 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.033852 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:36.041714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-350cb869-99f8-469f-ba3f-9e721ff4a7d6 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.202653 Sep 07 13:43:36.042285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 537/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:35 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:36.275364 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.276811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.297248 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.298110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.298730 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.299659 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.300333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.300922 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.478113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:36.487011 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1d43fc55-6a3a-47ed-83e4-3e536edce3ca tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.215876 Sep 07 13:43:36.487840 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 550/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:36 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:37.064745 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:37.065548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:37.072437 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:37.072931 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:37.073363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:37.074066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:37.074519 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:37.074937 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:37.217177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:37.225287 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-303b1d74-4a6a-4cce-b092-64d313339d48 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.164771 Sep 07 13:43:37.225892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 538/1088] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:37 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:37.512171 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:37.534570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:37.534570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:37.534570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:37.534570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:37.535190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:37.535190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:37.535190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:37.664691 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:37.672857 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c6fcf957-c2fa-4ca0-b66e-e5a3b2034dcb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.164854 Sep 07 13:43:37.673429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 551/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:37 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:38.257522 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:38.259806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:38.274602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:38.283102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:38.283102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:38.283102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:38.283102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:38.283558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:38.495665 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:38.505382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4fa5486d-61c1-47ac-894d-f958efb144fc tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.258326 Sep 07 13:43:38.519297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 539/1090] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:38 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:38.698352 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:38.704335 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:38.706167 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:38.706864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:38.707616 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:38.708574 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:38.710689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:38.711268 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:38.921198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:38.930548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-437a471e-b69d-4eac-a9c7-7a458b299056 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.236299 Sep 07 13:43:38.933382 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 552/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:38 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:39.530428 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:39.531057 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:39.537668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:39.538288 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:39.539339 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:39.540036 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:39.540483 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:39.540911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:39.682945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:39.690889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3ed1813f-8b5b-472d-ae7e-19d54b631873 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.164780 Sep 07 13:43:39.691544 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 540/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:39 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:39.954214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:39.955117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:39.964583 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:39.965625 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:39.966299 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:39.967107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:39.967729 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:39.968465 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:40.189198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:40.200119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b187992f-d185-4424-9714-e14d3cda14fb tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.249712 Sep 07 13:43:40.200821 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 553/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:39 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:40.715045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:40.718347 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:40.723804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:40.724409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:40.724850 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:40.725626 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:40.726091 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:40.726517 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:40.870380 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:40.878344 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d3761bae-6c76-4655-b374-71d091e38be1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.167972 Sep 07 13:43:40.878962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 541/1094] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:40 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:41.279602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:41.279602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:41.279602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:41.279602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:41.280924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:41.280924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:41.280924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:41.280924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:41.385667 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:41.394392 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-111d6911-a93e-466d-9a08-86125fa67af5 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.174456 Sep 07 13:43:41.394960 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 554/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:41 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:41.902099 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:41.902650 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:41.909403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:41.909885 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:41.910321 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:41.911093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:41.911546 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:41.911968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:42.046870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:42.054809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5cb25075-f17b-4370-a9dd-24fd0767247c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.156791 Sep 07 13:43:42.056156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 542/1096] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:41 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:42.418434 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:42.419125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:42.425877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:42.426360 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:42.426798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:42.427526 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:42.427985 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:42.428419 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:42.578348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:42.589558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-1b6d8f36-9707-47d9-8a46-58c507ee0355 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.175496 Sep 07 13:43:42.590246 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 555/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:42 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:42.936737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-aced0f19-5474-4c3c-813f-08aaf0721667 req-044e0445-e321-4aeb-acab-d89700567254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbec643b-c358-45bb-b883-bb17aed2675c", "name": "network-vif-plugged", "status": "completed", "tag": "76d34968-4f9c-4def-9047-acba7513944e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:42.954171 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-aced0f19-5474-4c3c-813f-08aaf0721667 req-044e0445-e321-4aeb-acab-d89700567254 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:42.954837 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-aced0f19-5474-4c3c-813f-08aaf0721667 req-044e0445-e321-4aeb-acab-d89700567254 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:42.955616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-aced0f19-5474-4c3c-813f-08aaf0721667 req-044e0445-e321-4aeb-acab-d89700567254 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:42.976445 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-aced0f19-5474-4c3c-813f-08aaf0721667 req-044e0445-e321-4aeb-acab-d89700567254 service nova] Creating event network-vif-plugged:76d34968-4f9c-4def-9047-acba7513944e for instance dbec643b-c358-45bb-b883-bb17aed2675c on hv-cinder-85625 Sep 07 13:43:42.986651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-aced0f19-5474-4c3c-813f-08aaf0721667 req-044e0445-e321-4aeb-acab-d89700567254 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055132 Sep 07 13:43:42.986651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 543/1098] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:43.082582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:43.084195 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:43.105492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:43.106334 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:43.106989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:43.107936 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:43.119917 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:43.124471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:43.150128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=100 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:43.614853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:43.615615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:43.627489 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:43.627995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:43.628557 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:43.629382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:43.630038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:43.630473 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:43.655993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:43.667224 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b1ea3718-a87f-4cfa-b242-60f739544f72 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.592400 Sep 07 13:43:43.667799 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 556/1099] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:43 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:43.775793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:43.784548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bf19c41d-19f3-418a-a3d9-6daedcdb6331 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.174155 Sep 07 13:43:43.785136 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 544/1100] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:43 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:44.369546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2108495845", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1952784259", "security_groups": [{"name": "tempest-secgroup-smoke-308951509"}], "block_device_mapping_v2": [{"uuid": "801a4c18-6141-4fa4-b9b8-cd0d201eae54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96dda948-6c1a-414d-b47c-330985b8eab3"}]}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:44.502558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.network.neutron [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] validate_networks() for [('96dda948-6c1a-414d-b47c-330985b8eab3', None, None, None, None, None)] {{(pid=151551) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:43:44.693776 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:44.694806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:44.707633 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:44.708480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:44.709228 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:44.710547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:44.711604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:44.712224 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:44.938882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:44.942860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=100 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:44.948761 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7a565a6a-c18d-4cfb-82bd-c8803d70724d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.259264 Sep 07 13:43:44.949360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 545/1101] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:44 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:44.971275 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:44.971904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:44.978861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:44.979434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:44.979882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:44.980622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:44.981089 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:44.981516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:45.069290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Flavor limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:43:45.070368 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Image limits 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:43:45.080491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Flavor pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:43:45.081128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Image pref 0:0:0 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:43:45.085696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.virt.hardware [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:43:45.106150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:45.107283 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:45.108410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:45.110546 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:45.112291 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:45.114055 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:45.159507 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:43:45.165907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.quota [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Getting quotas for user 9dae215cd92f46d18a3c1b7389c3af4b and project b4d5ce9b4fe34fc094bdacc3ca994537. Resources: {'instances', 'ram', 'cores'} {{(pid=151551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:43:45.180276 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:45.197038 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b2b9789f-ea60-46e1-a328-3aa7a6a79a08 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1315 microversion: 2.1 time: 0.229702 Sep 07 13:43:45.198060 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 546/1102] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:44 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:45.209919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-0d65cc8b-7818-4e7e-b21a-ddfc1fc91218 req-070eeed5-7417-4e84-8099-d6705ef59485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86", "name": "network-vif-plugged", "status": "completed", "tag": "50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:45.229226 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-0d65cc8b-7818-4e7e-b21a-ddfc1fc91218 req-070eeed5-7417-4e84-8099-d6705ef59485 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:45.230258 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-0d65cc8b-7818-4e7e-b21a-ddfc1fc91218 req-070eeed5-7417-4e84-8099-d6705ef59485 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:45.230832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-0d65cc8b-7818-4e7e-b21a-ddfc1fc91218 req-070eeed5-7417-4e84-8099-d6705ef59485 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:45.252605 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-0d65cc8b-7818-4e7e-b21a-ddfc1fc91218 req-070eeed5-7417-4e84-8099-d6705ef59485 service nova] Creating event network-vif-plugged:50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e for instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 on hv-cinder-85625 Sep 07 13:43:45.254317 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Going to run 1 instances... {{(pid=151551) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:43:45.260234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='801a4c18-6141-4fa4-b9b8-cd0d201eae54',volume_size=None,volume_type=None)] {{(pid=151551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:43:45.265360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-0d65cc8b-7818-4e7e-b21a-ddfc1fc91218 req-070eeed5-7417-4e84-8099-d6705ef59485 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061892 Sep 07 13:43:45.265360 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 547/1103] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:45.739071 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:45.977378 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:45.979245 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-6fdf5e65-fc41-4f06-8368-e5f8fc8a0156 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.614156 Sep 07 13:43:45.979951 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 557/1104] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:43:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:43:45.980351 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:45.988143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:45.988867 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:45.989383 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:45.990447 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:45.990719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:45.991264 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:45.994039 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c8953dfe-9a4f-44ab-9708-97d4aefe417d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:45.994719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c8953dfe-9a4f-44ab-9708-97d4aefe417d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:46.081996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c8953dfe-9a4f-44ab-9708-97d4aefe417d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:46.097766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c8953dfe-9a4f-44ab-9708-97d4aefe417d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1095 microversion: 2.1 time: 0.108695 Sep 07 13:43:46.099082 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 558/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:45 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1095 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:46.170945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:46.181909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-08bfdf7a-11ac-410c-90ea-a0672e6ec3ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.211479 Sep 07 13:43:46.182548 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 548/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:45 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:46.233652 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:46.234851 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:46.241354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:46.241855 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:46.242611 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:46.243481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:46.243958 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:46.244372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:46.406809 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:46.418172 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-12da78d5-ee82-4739-ba31-fac0b693a9cf tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1464 microversion: 2.1 time: 0.191106 Sep 07 13:43:46.418748 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 559/1107] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:46 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:46.481874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:46.482793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:46.494489 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:46.495904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:46.496177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:46.497472 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:46.498352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:46.500377 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:46.531914 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Going to try to terminate instance {{(pid=151552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:43:46.903098 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8c475a0f-3230-4ed3-a382-4b1436c716ff tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 204 len: 0 microversion: 2.1 time: 0.429719 Sep 07 13:43:46.903727 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 549/1108] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:43:46 2022] DELETE /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:43:46.912595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:46.914026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:46.921515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:46.922014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:46.922462 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:46.923222 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:46.923693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:46.924131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:47.079938 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:47.089597 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-013e4402-8be4-48ac-af06-79fc09e0e89d tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1470 microversion: 2.1 time: 0.180900 Sep 07 13:43:47.090321 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 560/1109] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:46 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:47.143274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:47.144068 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:47.156785 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:47.170053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:47.170053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:47.170053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:47.170053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:47.170857 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:47.216842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:47.216842 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:47.224719 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:47.225664 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:47.227494 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:47.228589 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:47.229453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:47.230473 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:47.257192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:47.272773 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a05c4757-c06d-41b4-9a7f-63d8e0db7d5a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1145 microversion: 2.1 time: 0.135070 Sep 07 13:43:47.273918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 550/1110] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:47 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1145 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:47.396886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:47.411134 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cd807265-a91c-44c5-bcdf-a9e018e2ee5b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1357 microversion: 2.1 time: 0.208058 Sep 07 13:43:47.411738 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 561/1111] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:47 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:48.122897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:48.124116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:48.136608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.137498 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.138296 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.139709 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.140961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.141748 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.303684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:48.304566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:48.313593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.314408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.314861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.315787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.316461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.317145 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.367471 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:48.382484 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6ef1ede7-ae90-49e5-ab28-ceaeae17f569 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1470 microversion: 2.1 time: 0.267640 Sep 07 13:43:48.383766 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 551/1112] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:48 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:48.411406 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:48.421100 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e1eafe48-98cb-44aa-93ab-08f84b0484a5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1145 microversion: 2.1 time: 0.122478 Sep 07 13:43:48.421712 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 562/1113] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:48 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1145 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:48.439920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:48.440619 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:48.448653 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.449395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.449911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.450779 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.451386 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.451880 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.646024 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:48.662835 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-bc02b729-793d-4256-ac16-195f2f2aef61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1547 microversion: 2.1 time: 0.229304 Sep 07 13:43:48.664438 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 552/1114] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:48 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1547 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:48.697482 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:48.698548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:48.710097 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.711675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.712558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.713906 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.714744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:48.715792 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:48.908855 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:48.925085 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bf1a3462-08c1-4b69-b5fd-5991c9e22a10 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1547 microversion: 2.1 time: 0.235258 Sep 07 13:43:48.926111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 563/1115] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:48 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1547 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:48.972434 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:48.983143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:48.985001 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Searching by: {'deleted': False, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c'} {{(pid=151552) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 13:43:48.998860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:48.999781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.000558 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.001916 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.002722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.003818 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.159102 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.multi_cell_list [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=151552) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 13:43:49.307066 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c42db15d-1c2d-4db6-9012-cd564526b1a5 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.341851 Sep 07 13:43:49.308039 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 553/1116] 10.222.0.62 () {58 vars in 1125 bytes} [Wed Sep 7 13:43:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:49.328110 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:49.332149 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:49.344828 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.346330 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.347559 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.348789 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.349614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.350374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.411861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:49.415010 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:49.424140 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.424681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.425410 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.426617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.427206 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.427650 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.588901 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:49.599509 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f4a79a48-2b57-42ab-b7ce-e29cc7c47010 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1547 microversion: 2.1 time: 0.278638 Sep 07 13:43:49.601241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 564/1117] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:49 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1547 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:49.607093 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:49.607890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:49.615329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.615885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.616332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.617855 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.618329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.619058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.647981 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:49.658242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-67a2413a-51e5-4b96-8fb2-143dafc014d3 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1470 microversion: 2.1 time: 0.253758 Sep 07 13:43:49.659245 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 554/1118] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:49 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:49.770260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:49.795275 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-640dc762-67c9-4405-a9ed-002eea258578 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1193 microversion: 2.1 time: 0.191886 Sep 07 13:43:49.796111 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 565/1119] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:49 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1193 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:49.998892 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-ecb07614-b543-4c9c-9e33-362fabcb2f8a req-fb742be2-40f8-4233-bd95-6bb3e7b1b6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbec643b-c358-45bb-b883-bb17aed2675c", "name": "network-vif-deleted", "tag": "76d34968-4f9c-4def-9047-acba7513944e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:50.021003 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-ecb07614-b543-4c9c-9e33-362fabcb2f8a req-fb742be2-40f8-4233-bd95-6bb3e7b1b6cd service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.023587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-ecb07614-b543-4c9c-9e33-362fabcb2f8a req-fb742be2-40f8-4233-bd95-6bb3e7b1b6cd service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.024006 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-ecb07614-b543-4c9c-9e33-362fabcb2f8a req-fb742be2-40f8-4233-bd95-6bb3e7b1b6cd service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.049120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-ecb07614-b543-4c9c-9e33-362fabcb2f8a req-fb742be2-40f8-4233-bd95-6bb3e7b1b6cd service nova] Creating event network-vif-deleted:76d34968-4f9c-4def-9047-acba7513944e for instance dbec643b-c358-45bb-b883-bb17aed2675c on hv-cinder-85625 Sep 07 13:43:50.062318 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-ecb07614-b543-4c9c-9e33-362fabcb2f8a req-fb742be2-40f8-4233-bd95-6bb3e7b1b6cd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184950 Sep 07 13:43:50.066145 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 555/1120] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:50.693399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:50.693399 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:50.711054 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.712144 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.712949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.715118 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.716025 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.716855 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.789802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.790005 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.790471 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.791193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lazy-loading 'fault' on Instance uuid dbec643b-c358-45bb-b883-bb17aed2675c {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:43:50.835604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:50.838086 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:50.859182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.859182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.859182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.859182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.859851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.859851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.884255 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d4eaa0c623240fa8e61d9aad069d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8407f7ed3645e2a15d5f9f08b43e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:50.899019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-10d79032-97be-457d-862c-3fa1606bf6fa tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 200 len: 1305 microversion: 2.1 time: 0.214900 Sep 07 13:43:50.900381 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 566/1121] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:50 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 1305 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:51.001950 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:51.011363 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a6bc3507-9327-4f4f-9e26-b232a777cf2c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1211 microversion: 2.1 time: 0.186337 Sep 07 13:43:51.015026 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 556/1122] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:50 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1211 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:51.934531 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:51.935358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] [instance: dbec643b-c358-45bb-b883-bb17aed2675c] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:51.950542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:51.951351 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:51.952430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:51.952972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:51.953914 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:51.954591 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:51.975433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] HTTP exception thrown: Instance dbec643b-c358-45bb-b883-bb17aed2675c could not be found. Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Request method failure captured: Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c HTTP/1.1 Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ_2zvShCRILxw9_zm7t1eJOiUY5qIkq_kWqir7wXSHeLGMzBd-aS2IBv7TSM7SS9Z96mt32qmJDoMRMXUzEoC-c2VT5QBbWTQ-XHo1Oxi9MeshX0NCq-puo0SRnQMwHBr-A1b12A3HNjVtAeo3UPI28uTi4ZKWkPSz33M_2ZxlAht4 Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: 4e8407f7ed3645e2a15d5f9f08b43e0d Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-VolumesNegativeTest-1885703671 Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:43:51.977911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4e8407f7ed3645e2a15d5f9f08b43e0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4e8407f7ed3645e2a15d5f9f08b43e0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4e8407f7ed3645e2a15d5f9f08b43e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4e8407f7ed3645e2a15d5f9f08b43e0d", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-VolumesNegativeTest-1885703671 Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: 4e8407f7ed3645e2a15d5f9f08b43e0d Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-VolumesNegativeTest-1885703671 Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-VolumesNegativeTest-1885703671-project Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 9d4eaa0c623240fa8e61d9aad069d7c9 Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-VolumesNegativeTest-1885703671-project Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance dbec643b-c358-45bb-b883-bb17aed2675c could not be found. Sep 07 13:43:51.979640 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': 'dbec643b-c358-45bb-b883-bb17aed2675c'} Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbec643b-c358-45bb-b883-bb17aed2675c could not be found. Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:51.980566 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbec643b-c358-45bb-b883-bb17aed2675c could not be found. Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbec643b-c358-45bb-b883-bb17aed2675c could not be found. Sep 07 13:43:51.982193 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:43:51.983859 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] Returning 404 to user: Instance dbec643b-c358-45bb-b883-bb17aed2675c could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:51.983859 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bf72840a-78a6-48da-9fa5-b701238ed544 tempest-VolumesNegativeTest-1885703671 tempest-VolumesNegativeTest-1885703671-project] 10.222.0.62 "GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c" status: 404 len: 111 microversion: 2.1 time: 0.050367 Sep 07 13:43:51.984654 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 567/1123] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:51 2022] GET /compute/v2.1/servers/dbec643b-c358-45bb-b883-bb17aed2675c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:52.044951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:52.045739 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:52.055924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:52.056611 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:52.057285 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:52.058170 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:52.058899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:52.059576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:52.312652 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:52.324926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-8a01ec31-e7aa-43ab-8c39-fc045e5227d5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1278 microversion: 2.1 time: 0.285794 Sep 07 13:43:52.336463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 557/1124] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:52 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:52.488650 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1edd849f-7076-4897-8cb7-e63e2e347b2c"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:52.491568 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:52.500863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:52.501724 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:52.503119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:52.504153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:52.505689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:52.505689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:53.131133 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-dd3d0977-25ec-4d33-9428-8bdb7c904016 req-6686e0ff-4b75-4dcd-b544-9af136e64b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b03803f6-7a36-4a80-8dbb-3e1ee64b07ff", "tag": "eef052d3-2830-45b1-8172-dff7206918fa"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:53.146955 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:53.153211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-dd3d0977-25ec-4d33-9428-8bdb7c904016 req-6686e0ff-4b75-4dcd-b544-9af136e64b10 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:53.153714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-dd3d0977-25ec-4d33-9428-8bdb7c904016 req-6686e0ff-4b75-4dcd-b544-9af136e64b10 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:53.154187 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-dd3d0977-25ec-4d33-9428-8bdb7c904016 req-6686e0ff-4b75-4dcd-b544-9af136e64b10 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:53.175957 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-dd3d0977-25ec-4d33-9428-8bdb7c904016 req-6686e0ff-4b75-4dcd-b544-9af136e64b10 service nova] Creating event network-changed:eef052d3-2830-45b1-8172-dff7206918fa for instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff on hv-cinder-85625 Sep 07 13:43:53.184345 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-dd3d0977-25ec-4d33-9428-8bdb7c904016 req-6686e0ff-4b75-4dcd-b544-9af136e64b10 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060457 Sep 07 13:43:53.185269 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 558/1125] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:43:53.353255 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:53.354666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:53.363901 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:53.364294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:53.364754 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:53.365870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:53.366660 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:53.367537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:53.631182 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:53.640523 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d1ec97cb-5aae-4b55-9fe5-a5683b92f1b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.294126 Sep 07 13:43:53.641116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 559/1126] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:53 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:53.881582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-260ae232-89da-463f-b4c7-22c0e65dad13 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.397402 Sep 07 13:43:53.882186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 568/1127] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 7 13:43:52 2022] POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments => generated 194 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:54.665425 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:54.666074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:54.675024 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:54.675906 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:54.676672 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:54.677962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:54.678800 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:54.679761 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:54.881521 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:54.890705 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6f94c996-6744-4b9b-8d30-be9939848699 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.230279 Sep 07 13:43:54.891645 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 560/1128] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:54 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:55.916112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:55.920632 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:55.921352 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:55.929219 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:55.930213 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:55.930680 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:55.931555 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:55.932013 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:55.932444 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:56.090602 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=8 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:56.129948 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:56.142186 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-8334552d-962d-45dc-86c7-9524ee6e89d8 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.228224 Sep 07 13:43:56.142911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 569/1129] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:55 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:57.175153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:57.175153 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:57.178771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:57.181629 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:57.182552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:57.183964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:57.185141 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:57.186110 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:57.392223 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:57.402398 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-42debf67-a36e-450f-9159-7b70d2801956 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.237519 Sep 07 13:43:57.403020 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 561/1130] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:57 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:58.436496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:58.437137 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:58.445941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:58.446650 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:58.446992 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:58.448047 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:58.448253 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:58.448618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:58.603939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:58.613732 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-2b407f40-d6d0-4e4e-a1da-c6831c36342a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.182812 Sep 07 13:43:58.614429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 570/1131] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:58 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:59.637115 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:59.638462 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:59.640899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:59.646482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:59.651143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:59.651143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:59.651143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:59.651143 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:59.651719 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:59.675378 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:59.809684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:59.818948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7207127b-8d68-4668-be2e-819f91c8ba45 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.186005 Sep 07 13:43:59.819576 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 562/1132] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:59 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:00.842780 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:00.843429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:00.850385 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:00.850925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:00.851935 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:00.852734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:00.853344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:00.853783 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:01.016081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:01.027698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5b43aceb-4f8f-496e-b070-adea7678de0b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.188932 Sep 07 13:44:01.028644 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 571/1133] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:00 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:02.053949 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:02.054646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:02.064770 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:02.065497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:02.066210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:02.067065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:02.067616 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:02.068064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:02.266185 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:02.277516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7fa7fc6f-f409-4345-8abb-fc71d04878bf tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.227875 Sep 07 13:44:02.278766 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 563/1134] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:02 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:02.796808 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:02.797432 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:02.805921 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:02.806422 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:02.807187 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:02.808119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:02.808758 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:02.809188 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:03.015868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:03.027764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-95b37f85-76e3-4d8d-aa37-9309a611f995 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1593 microversion: 2.1 time: 0.234864 Sep 07 13:44:03.029447 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 572/1135] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:02 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1593 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:03.309847 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:03.310681 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:03.318532 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:03.319081 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:03.319509 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:03.321048 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:03.321538 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:03.321964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:03.596242 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:03.608343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-efc0990e-0ce3-4891-8f42-1f0ab34bc345 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.301955 Sep 07 13:44:03.609209 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 564/1136] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:03 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:44:04.634923 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:04.636332 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:04.644965 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:04.645744 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:04.646385 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:04.648639 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:04.649321 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:04.649954 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:04.982288 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:04.986931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:04.994325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5384eaff-f756-4e5e-af5f-a94883d15230 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.363421 Sep 07 13:44:04.994989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 573/1137] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:04 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:05.669774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-be6e8e53-293c-47b3-83a0-8c261c6e0a28 req-ab5bbadd-1d6b-4191-9c67-eafb1cf421fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03803f6-7a36-4a80-8dbb-3e1ee64b07ff", "name": "network-vif-plugged", "status": "completed", "tag": "eef052d3-2830-45b1-8172-dff7206918fa"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:05.681820 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-be6e8e53-293c-47b3-83a0-8c261c6e0a28 req-ab5bbadd-1d6b-4191-9c67-eafb1cf421fe service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:05.682371 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-be6e8e53-293c-47b3-83a0-8c261c6e0a28 req-ab5bbadd-1d6b-4191-9c67-eafb1cf421fe service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:05.683199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-be6e8e53-293c-47b3-83a0-8c261c6e0a28 req-ab5bbadd-1d6b-4191-9c67-eafb1cf421fe service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:05.698259 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-be6e8e53-293c-47b3-83a0-8c261c6e0a28 req-ab5bbadd-1d6b-4191-9c67-eafb1cf421fe service nova] Creating event network-vif-plugged:eef052d3-2830-45b1-8172-dff7206918fa for instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff on hv-cinder-85625 Sep 07 13:44:05.701965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-be6e8e53-293c-47b3-83a0-8c261c6e0a28 req-ab5bbadd-1d6b-4191-9c67-eafb1cf421fe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376449 Sep 07 13:44:05.702587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 565/1138] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:06.026293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:06.030612 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:06.042742 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:06.043599 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:06.044540 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:06.045811 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:06.046597 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:06.047214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:06.378696 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-f6bd6b37-8c09-45a7-94c6-5ceefca1304f req-5eba4b1b-54ad-4459-8639-eb74c60aba04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86", "tag": "50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:06.394992 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-f6bd6b37-8c09-45a7-94c6-5ceefca1304f req-5eba4b1b-54ad-4459-8639-eb74c60aba04 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:06.402889 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-f6bd6b37-8c09-45a7-94c6-5ceefca1304f req-5eba4b1b-54ad-4459-8639-eb74c60aba04 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:06.403663 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-f6bd6b37-8c09-45a7-94c6-5ceefca1304f req-5eba4b1b-54ad-4459-8639-eb74c60aba04 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:06.420407 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-f6bd6b37-8c09-45a7-94c6-5ceefca1304f req-5eba4b1b-54ad-4459-8639-eb74c60aba04 service nova] Creating event network-changed:50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e for instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 on hv-cinder-85625 Sep 07 13:44:06.428180 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-f6bd6b37-8c09-45a7-94c6-5ceefca1304f req-5eba4b1b-54ad-4459-8639-eb74c60aba04 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155077 Sep 07 13:44:06.429482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 566/1139] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:44:06.508004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:06.518802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c83d75cf-1871-4514-9f3d-0a72691b027e tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.499512 Sep 07 13:44:06.519927 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 574/1140] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:06 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:07.560261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:07.567303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:07.588585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:07.589313 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:07.589894 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:07.590735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:07.591337 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:07.591962 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:07.873374 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:07.890169 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b5a537fa-5c0c-4036-b6cd-549225f349cd tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1266 microversion: 2.1 time: 0.339286 Sep 07 13:44:07.891428 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 567/1141] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:07 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:08.922128 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:08.924747 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:08.942354 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:08.943451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:08.944585 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:08.947411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:08.948595 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:08.949672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:09.145126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:09.154684 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a7959ed5-65cc-4a18-bd6b-5806a88c0912 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1453 microversion: 2.1 time: 0.239930 Sep 07 13:44:09.155552 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 575/1142] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:08 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:09.182966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:09.185985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:09.194384 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:09.196283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:09.197777 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:09.199920 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:09.201217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:09.202071 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:09.695109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:09.704353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6f81264f-4871-46af-83be-9acb9d18c99a tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1453 microversion: 2.1 time: 0.529608 Sep 07 13:44:09.705707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 568/1143] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:09 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1453 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:10.993865 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-537187290"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:10.996466 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:11.009477 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:11.010043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:11.010628 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:11.011830 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:11.012385 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:11.012876 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:11.248990 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.network.security_group_api [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Adding security group e182aaf2-739a-47f0-85cd-a5d20f5031f4 to port 50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e Sep 07 13:44:11.928342 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-411d2c2d-ce17-4c78-8053-652dab0870a2 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/action" status: 202 len: 0 microversion: 2.1 time: 0.940739 Sep 07 13:44:11.929234 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 576/1144] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:44:10 2022] POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/action => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:44:11.938966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:11.940609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:11.955894 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:11.956829 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:11.957589 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:11.958526 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:11.959580 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:11.960585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:12.005890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-35993528-1b0c-4974-aa0f-a2004f9919d2 req-1820908e-8509-4cf7-ab94-9c11a25cce70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86", "tag": "50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:12.036988 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-35993528-1b0c-4974-aa0f-a2004f9919d2 req-1820908e-8509-4cf7-ab94-9c11a25cce70 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:12.038576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-35993528-1b0c-4974-aa0f-a2004f9919d2 req-1820908e-8509-4cf7-ab94-9c11a25cce70 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:12.039704 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-35993528-1b0c-4974-aa0f-a2004f9919d2 req-1820908e-8509-4cf7-ab94-9c11a25cce70 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:12.065474 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-35993528-1b0c-4974-aa0f-a2004f9919d2 req-1820908e-8509-4cf7-ab94-9c11a25cce70 service nova] Creating event network-changed:50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e for instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 on hv-cinder-85625 Sep 07 13:44:12.092527 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-35993528-1b0c-4974-aa0f-a2004f9919d2 req-1820908e-8509-4cf7-ab94-9c11a25cce70 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092408 Sep 07 13:44:12.093517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 577/1145] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:44:12.545774 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:12.555979 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-68ee8563-71bd-470f-8f1e-828bd1670e7f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1758 microversion: 2.1 time: 0.621904 Sep 07 13:44:12.583053 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 569/1146] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:11 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1758 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:14.474371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-50f10a3f-25b9-4fce-b00c-68712a57b459 req-323c28b9-d980-412e-9709-a2a8afecb155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b03803f6-7a36-4a80-8dbb-3e1ee64b07ff", "tag": "eef052d3-2830-45b1-8172-dff7206918fa"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:14.494529 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-50f10a3f-25b9-4fce-b00c-68712a57b459 req-323c28b9-d980-412e-9709-a2a8afecb155 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:14.495398 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-50f10a3f-25b9-4fce-b00c-68712a57b459 req-323c28b9-d980-412e-9709-a2a8afecb155 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:14.496287 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-50f10a3f-25b9-4fce-b00c-68712a57b459 req-323c28b9-d980-412e-9709-a2a8afecb155 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:14.517557 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-50f10a3f-25b9-4fce-b00c-68712a57b459 req-323c28b9-d980-412e-9709-a2a8afecb155 service nova] Creating event network-changed:eef052d3-2830-45b1-8172-dff7206918fa for instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff on hv-cinder-85625 Sep 07 13:44:14.526931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-50f10a3f-25b9-4fce-b00c-68712a57b459 req-323c28b9-d980-412e-9709-a2a8afecb155 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058992 Sep 07 13:44:14.535191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 578/1147] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:21.947155 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=23 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:21.971790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9cc95fe0-919a-485e-bea2-6481ec1b14df tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Action: 'create', calling method: .version_select at 0x7f1747f851f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-506453658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9Q5kogIyDjbgGVsrv4JHLlFCjOn/INm9Rxf87Smtgl50BtAytilFFXuzhhPdidwDonFiCzyQ6cjiU3dKN8u+Sn4yjDTXBlI34IGGGHauZv3erK8kFI0BwhGCHcAt5o7w=="}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:21.989900 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-9cc95fe0-919a-485e-bea2-6481ec1b14df tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Getting quotas for project bb7b613bf3c94b4aa49f450be9971774. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:44:21.994752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-9cc95fe0-919a-485e-bea2-6481ec1b14df tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Getting quotas for user 138facb7768545999dd43217600771a3 and project bb7b613bf3c94b4aa49f450be9971774. Resources: {'key_pairs'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:44:22.045988 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:22.049139 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:22.052314 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=47 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:22.060023 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:22.060523 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:22.060963 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:22.061672 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:22.062120 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:22.062541 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:22.100082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9cc95fe0-919a-485e-bea2-6481ec1b14df tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.329728 Sep 07 13:44:22.101623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 570/1148] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 7 13:44:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:22.456122 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-9768b325-3e1c-48d2-b84e-b86f1799317c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/action" status: 202 len: 0 microversion: 2.1 time: 0.416433 Sep 07 13:44:22.471517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 579/1149] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:44:22 2022] POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:44:22.479581 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:22.480195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:22.490486 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:22.491051 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:22.491497 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:22.492431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:22.492894 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:22.493324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:22.692535 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:22.702329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-888092cf-7d9e-4c02-a32b-58f8f8082860 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1750 microversion: 2.1 time: 0.226927 Sep 07 13:44:22.702945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 571/1150] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:22 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1750 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:23.730245 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:23.731945 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:23.739900 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:23.740763 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:23.741586 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:23.742636 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:23.743341 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:23.743956 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:23.965393 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:23.974545 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cbab9894-9cbf-4dc1-b967-dc5ef25d89ad tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1750 microversion: 2.1 time: 0.250618 Sep 07 13:44:23.975501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 580/1151] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:23 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1750 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:25.009994 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:25.011174 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:25.025995 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:25.029096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:25.029096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:25.029096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:25.031230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:25.032377 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:25.285302 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:25.295843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-888cbdce-e68d-48ab-b28b-34a2a637d291 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.297335 Sep 07 13:44:25.296665 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 572/1152] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:24 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:26.323464 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:26.324206 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:26.332403 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:26.332932 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:26.333369 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:26.334230 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:26.334656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:26.336014 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:26.507510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:26.516215 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-bc24af48-e808-4682-bfaf-e6ee1cf1bbe9 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.198323 Sep 07 13:44:26.519035 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 581/1153] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:26 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:27.541980 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:27.542687 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:27.549968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:27.550572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:27.551097 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:27.551918 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:27.552781 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:27.552932 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:27.725841 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:27.731359 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dc92a8f2-14d4-4e80-b000-f46081370418 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.194105 Sep 07 13:44:27.731957 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 573/1154] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:27 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:28.757242 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:28.757880 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:28.764631 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:28.765115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:28.765582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:28.766365 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:28.766734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:28.767224 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:28.938448 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:28.947166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-eae791c1-803f-499c-a28f-874ad1087097 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.194269 Sep 07 13:44:28.947818 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 582/1155] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:28 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:29.972790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:29.973678 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:29.979987 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:29.981165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:29.981165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:29.981604 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:29.982069 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:29.982485 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:30.149947 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:30.160109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f4b28563-4d4e-4ddf-bf70-9ed46307121b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.192425 Sep 07 13:44:30.160999 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 574/1156] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:29 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:31.185086 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:31.185786 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:31.193571 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:31.194068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:31.194730 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:31.196411 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:31.196829 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:31.197049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:31.355390 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:31.364329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-7f56147b-4bbd-472c-ba88-f3de60233256 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.183434 Sep 07 13:44:31.364909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 583/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:31 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:44:32.390481 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:32.391437 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:32.394100 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=4 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:32.400309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:32.400819 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:32.401326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:32.402230 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:32.402708 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:32.403217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:32.696198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:32.715637 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4d6c974b-cd4c-4687-a7d7-502d92701c7c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.328775 Sep 07 13:44:32.716707 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 575/1158] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:32 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:33.745646 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:33.746221 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:33.753351 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:33.753820 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:33.754236 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:33.754962 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:33.755461 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:33.755875 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:33.990428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:34.009823 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-3638ffd2-bbf4-4d20-a508-1dce11229d71 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.268969 Sep 07 13:44:34.011015 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 584/1159] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:33 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:35.037211 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:35.037946 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:35.046513 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:35.047123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:35.047614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:35.048431 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:35.048928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:35.049413 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:35.053261 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=67 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:35.285717 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:35.300146 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-adc5d933-3550-4a5b-ab84-e8d0e918ba41 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.266735 Sep 07 13:44:35.300845 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 576/1160] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:35 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:36.335429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:36.337160 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:36.345995 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:36.346487 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:36.346926 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:36.347689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:36.348135 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:36.348557 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:36.542609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:36.552358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4ec4a354-8962-475f-b31e-6434bd108f61 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.220925 Sep 07 13:44:36.552966 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 585/1161] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:36 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:37.583882 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:37.585993 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:37.598151 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:37.599040 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:37.599787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:37.601924 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:37.602878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:37.603664 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:37.855064 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:37.866060 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-844e38ad-729e-4c4c-b2a6-ed2c9ebf0cb7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.291492 Sep 07 13:44:37.867405 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 577/1162] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:37 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:38.908293 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:38.909697 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:38.916126 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:38.916609 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:38.917038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:38.917739 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:38.918201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:38.918843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:39.099207 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:39.102305 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:39.110119 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e3cd6e4f-a903-438d-8a89-550967301a11 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.205763 Sep 07 13:44:39.110698 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 586/1163] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:38 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:40.139118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:40.140319 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:40.154072 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:40.154954 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:40.155722 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:40.157025 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:40.157897 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:40.158687 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:40.365731 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:40.379309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e3a6a28c-666e-4038-8220-38e1cc1876c7 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1755 microversion: 2.1 time: 0.248471 Sep 07 13:44:40.379910 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 578/1164] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:40 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:41.405358 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:41.405993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:41.413643 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:41.414130 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:41.414573 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:41.415321 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:41.415772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:41.416194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:41.574397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:41.584827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-201251cf-0e6c-49b3-98b7-d307f9aa0275 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1758 microversion: 2.1 time: 0.184220 Sep 07 13:44:41.586456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 587/1165] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:41 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:43.022189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2001854306", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-506453658", "security_groups": [{"name": "tempest-secgroup-smoke-1761993006"}], "networks": [{"uuid": "12cd95e1-4391-4540-adda-eeab0b5fca4a"}], "block_device_mapping_v2": [{"uuid": "a0c21b66-465c-4242-94a1-7f7b8747e49c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:43.161842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.network.neutron [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] validate_networks() for [('12cd95e1-4391-4540-adda-eeab0b5fca4a', None, None, None, None, None)] {{(pid=151552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:44:43.682843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Flavor limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:44:43.683306 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Image limits 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:44:43.683775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Flavor pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:44:43.684195 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Image pref 0:0:0 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:44:43.684585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.virt.hardware [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=151552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:44:43.693433 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:43.693838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:43.694266 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:43.695966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:43.696415 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:43.696839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:43.713952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Getting quotas for project bb7b613bf3c94b4aa49f450be9971774. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:44:43.718271 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.quota [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Getting quotas for user 138facb7768545999dd43217600771a3 and project bb7b613bf3c94b4aa49f450be9971774. Resources: {'instances', 'ram', 'cores'} {{(pid=151552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:44:43.783387 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Going to run 1 instances... {{(pid=151552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:44:43.786512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0c21b66-465c-4242-94a1-7f7b8747e49c',volume_size=None,volume_type=None)] {{(pid=151552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:44:44.273793 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-e96bbf64-8655-431b-91d0-7eb1149c8647 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.255400 Sep 07 13:44:44.274950 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 579/1166] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 7 13:44:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:44:44.289430 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-47f4de6f-bc56-4dae-b868-294518a3fc38 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:44.290423 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-47f4de6f-bc56-4dae-b868-294518a3fc38 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:44.369949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-47f4de6f-bc56-4dae-b868-294518a3fc38 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:44.381717 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-47f4de6f-bc56-4dae-b868-294518a3fc38 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1088 microversion: 2.1 time: 0.098007 Sep 07 13:44:44.382480 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 588/1167] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:44 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1088 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:45.407035 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-68b2d3f7-2c35-42f5-bec3-031d2b9d75cc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:45.407926 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-68b2d3f7-2c35-42f5-bec3-031d2b9d75cc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:45.479710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-68b2d3f7-2c35-42f5-bec3-031d2b9d75cc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:45.487357 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-68b2d3f7-2c35-42f5-bec3-031d2b9d75cc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1088 microversion: 2.1 time: 0.085163 Sep 07 13:44:45.487952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 580/1168] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:45 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:46.511019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:46.511618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:46.520362 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:46.520890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:46.521857 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:46.522603 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:46.523090 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:46.523526 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:46.612167 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:46.621670 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5df47237-5b54-4745-9a4d-ea197f4097db tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1186 microversion: 2.1 time: 0.115287 Sep 07 13:44:46.622258 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 589/1169] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:46 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1186 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:47.652073 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:47.653888 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:47.662721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:47.663711 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:47.663886 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:47.664690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:47.665248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:47.665753 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:47.738294 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:47.747911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-54f03624-c5dc-4872-a16b-2cb296462306 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1204 microversion: 2.1 time: 0.100232 Sep 07 13:44:47.748730 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 581/1170] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:47 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:48.779192 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:48.779833 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:48.786410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:48.786908 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:48.787384 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:48.788662 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:48.789873 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:48.790250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:48.959370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:48.968826 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-16532bc7-ac8e-481a-affd-acba1c534936 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1272 microversion: 2.1 time: 0.194000 Sep 07 13:44:48.969424 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 590/1171] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:48 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:49.477630 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-1344f0a5-7209-49e8-97a3-9ba723603007 req-cdd84cc9-9a47-49b3-96f1-0d023bd0bc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720272c0-a76c-4ffa-9919-9e7de8ae67d4", "tag": "4b7ed7f0-d994-44b6-b1e2-b89cd4681072"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:49.489837 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-1344f0a5-7209-49e8-97a3-9ba723603007 req-cdd84cc9-9a47-49b3-96f1-0d023bd0bc0b service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:49.490614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-1344f0a5-7209-49e8-97a3-9ba723603007 req-cdd84cc9-9a47-49b3-96f1-0d023bd0bc0b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:49.491141 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-1344f0a5-7209-49e8-97a3-9ba723603007 req-cdd84cc9-9a47-49b3-96f1-0d023bd0bc0b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:49.503854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-1344f0a5-7209-49e8-97a3-9ba723603007 req-cdd84cc9-9a47-49b3-96f1-0d023bd0bc0b service nova] Creating event network-changed:4b7ed7f0-d994-44b6-b1e2-b89cd4681072 for instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 on hv-cinder-85625 Sep 07 13:44:49.509685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-1344f0a5-7209-49e8-97a3-9ba723603007 req-cdd84cc9-9a47-49b3-96f1-0d023bd0bc0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036956 Sep 07 13:44:49.510843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 582/1172] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:49.996638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:49.997920 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:50.010772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:50.011715 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:50.012483 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:50.013959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:50.014788 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:50.015615 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:50.181899 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:50.190635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-81ccc5ae-0242-49df-a6a0-ccf1ff2aaba6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.201576 Sep 07 13:44:50.203000 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 591/1173] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:49 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:51.216491 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:51.217191 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:51.223463 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:51.223951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:51.224390 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:51.225096 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:51.225541 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:51.226009 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:51.362864 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:51.371673 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-921ad1cb-1b17-424e-8ac0-2c0807006b52 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.159852 Sep 07 13:44:51.372248 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 583/1174] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:51 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:52.395413 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:52.396033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:52.398565 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=28 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:52.403766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:52.404286 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:52.404720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:52.405417 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:52.405869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:52.406290 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:52.545695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:52.554444 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-4fc44e50-ab36-43b4-b646-0ef5f16ea077 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.162197 Sep 07 13:44:52.555044 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 592/1175] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:52 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:53.577017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:53.577668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:53.580685 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:53.586385 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:53.586877 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:53.587353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:53.588074 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:53.588537 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:53.588970 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:53.703968 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:53.729810 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:53.737572 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-78e24716-bce6-4457-9fb3-793c8492cb4f tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.164481 Sep 07 13:44:53.738790 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 584/1176] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:53 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:54.762338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:54.763078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:54.765397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell0:SELECT=2 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:54.770730 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:54.771250 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:54.771694 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:54.772440 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:54.772890 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:54.773310 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:54.919516 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:54.927515 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-552f4673-2386-495f-8648-4e48f51c47ba tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.169331 Sep 07 13:44:54.928098 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 593/1177] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:54 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:55.953262 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:55.954249 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:55.956317 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell0:SELECT=8 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:55.962109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:55.969352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:55.969352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:55.969352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:55.969352 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:55.969965 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:56.147499 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:56.156811 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fde29dc8-5a60-4756-a456-c1b0311d1995 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.207853 Sep 07 13:44:56.157623 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 585/1178] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:55 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:44:57.181222 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:57.181843 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:57.189107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:57.189591 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:57.190026 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:57.190721 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:57.191209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:57.191634 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:57.331408 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:57.340262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-29403276-9e8c-4068-88ef-d6704fd470d1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.163202 Sep 07 13:44:57.340828 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 594/1179] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:57 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:58.363240 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:58.363856 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:58.371034 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:58.371534 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:58.371975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:58.372735 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:58.373191 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:58.373622 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:58.516945 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:58.526014 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-306fad5c-1a61-4986-82c0-281c330dd56d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.166033 Sep 07 13:44:58.526014 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 586/1180] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:58 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:59.553749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:59.554861 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:59.566359 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:59.567260 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:59.568063 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:59.569800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:59.570637 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:59.571460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:59.734855 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:59.743329 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-97926adb-71f1-4d9d-a653-4026b96c7a24 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.196696 Sep 07 13:44:59.743910 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 595/1181] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:59 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:00.768171 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:00.768731 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:00.775165 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:00.775646 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:00.776083 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:00.776771 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:00.777225 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:00.777904 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:00.916849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:00.924931 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6d943abe-0692-41d0-b817-ef0cb74d44a1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.160701 Sep 07 13:45:00.925533 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 587/1182] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:00 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:01.249510 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-082afa67-3a90-4aa8-9850-760bc5a0bd65 req-5e59d1ac-2310-4aef-9e70-c923979768c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720272c0-a76c-4ffa-9919-9e7de8ae67d4", "name": "network-vif-plugged", "status": "completed", "tag": "4b7ed7f0-d994-44b6-b1e2-b89cd4681072"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:01.260552 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-082afa67-3a90-4aa8-9850-760bc5a0bd65 req-5e59d1ac-2310-4aef-9e70-c923979768c0 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:01.261455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-082afa67-3a90-4aa8-9850-760bc5a0bd65 req-5e59d1ac-2310-4aef-9e70-c923979768c0 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:01.261455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-082afa67-3a90-4aa8-9850-760bc5a0bd65 req-5e59d1ac-2310-4aef-9e70-c923979768c0 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:01.274166 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-082afa67-3a90-4aa8-9850-760bc5a0bd65 req-5e59d1ac-2310-4aef-9e70-c923979768c0 service nova] Creating event network-vif-plugged:4b7ed7f0-d994-44b6-b1e2-b89cd4681072 for instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 on hv-cinder-85625 Sep 07 13:45:01.280427 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-082afa67-3a90-4aa8-9850-760bc5a0bd65 req-5e59d1ac-2310-4aef-9e70-c923979768c0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034507 Sep 07 13:45:01.281043 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 596/1183] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:01.949370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:01.950253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:01.959000 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:01.960015 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:01.960452 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:01.961281 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:01.961737 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:01.962175 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:02.108921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:02.117443 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-0fcd4000-7c28-4f32-8101-a51843697900 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1260 microversion: 2.1 time: 0.172098 Sep 07 13:45:02.118012 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 588/1184] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:01 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:03.143099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:03.143718 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:03.150687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:03.151204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:03.151638 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:03.152614 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:03.153079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:03.153496 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:03.290315 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:03.298127 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-64b32c18-4e31-42c0-8534-08a404769cfe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1444 microversion: 2.1 time: 0.159987 Sep 07 13:45:03.298682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 597/1185] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:03 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:03.321323 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:03.321928 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:03.327951 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:03.328436 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:03.328899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:03.329587 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:03.330042 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:03.330467 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:03.472880 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:03.481855 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9e59fabc-bcb4-42ff-82b6-efd5fc523f1c tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1444 microversion: 2.1 time: 0.165469 Sep 07 13:45:03.482946 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 589/1186] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:03 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:05.658847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-8939f3e5-dea4-4da2-8969-9e83f8a51d19 req-129d129a-67b6-4f8b-b8cc-ca4fa572a3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720272c0-a76c-4ffa-9919-9e7de8ae67d4", "tag": "4b7ed7f0-d994-44b6-b1e2-b89cd4681072"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:05.669955 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8939f3e5-dea4-4da2-8969-9e83f8a51d19 req-129d129a-67b6-4f8b-b8cc-ca4fa572a3a8 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:05.670714 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8939f3e5-dea4-4da2-8969-9e83f8a51d19 req-129d129a-67b6-4f8b-b8cc-ca4fa572a3a8 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:05.671196 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-8939f3e5-dea4-4da2-8969-9e83f8a51d19 req-129d129a-67b6-4f8b-b8cc-ca4fa572a3a8 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:05.685453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-8939f3e5-dea4-4da2-8969-9e83f8a51d19 req-129d129a-67b6-4f8b-b8cc-ca4fa572a3a8 service nova] Creating event network-changed:4b7ed7f0-d994-44b6-b1e2-b89cd4681072 for instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 on hv-cinder-85625 Sep 07 13:45:05.691033 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-8939f3e5-dea4-4da2-8969-9e83f8a51d19 req-129d129a-67b6-4f8b-b8cc-ca4fa572a3a8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036681 Sep 07 13:45:05.691696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 598/1187] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:15.117689 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-537187290"}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:15.118353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:15.121378 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=11 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:15.122123 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=69 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:15.126964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:15.133111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:15.133111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:15.133111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:15.133111 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:15.133500 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:15.284961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.network.security_group_api [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Removing security group e182aaf2-739a-47f0-85cd-a5d20f5031f4 from port 50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e Sep 07 13:45:15.764786 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-9d4dea56-fa33-4082-a30e-bc4930e69667 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/action" status: 202 len: 0 microversion: 2.1 time: 0.651877 Sep 07 13:45:15.765382 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 590/1188] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:45:15 2022] POST /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:45:15.774696 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-9f3a4314-c1db-4c6a-88b3-8d50d6b84f2a req-113c8690-4711-4eae-a8db-8c13d8311f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86", "tag": "50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:15.792442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=13 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:15.792442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=59 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:15.792442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-9f3a4314-c1db-4c6a-88b3-8d50d6b84f2a req-113c8690-4711-4eae-a8db-8c13d8311f7c service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:15.792442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-9f3a4314-c1db-4c6a-88b3-8d50d6b84f2a req-113c8690-4711-4eae-a8db-8c13d8311f7c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:15.792442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-9f3a4314-c1db-4c6a-88b3-8d50d6b84f2a req-113c8690-4711-4eae-a8db-8c13d8311f7c service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:15.800633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-9f3a4314-c1db-4c6a-88b3-8d50d6b84f2a req-113c8690-4711-4eae-a8db-8c13d8311f7c service nova] Creating event network-changed:50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e for instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 on hv-cinder-85625 Sep 07 13:45:15.806941 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-9f3a4314-c1db-4c6a-88b3-8d50d6b84f2a req-113c8690-4711-4eae-a8db-8c13d8311f7c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036435 Sep 07 13:45:15.807921 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 599/1189] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:17.268129 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:17.272189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:17.272341 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-49d72af5-9b77-4136-877c-8ada874ecad4 req-477a7e03-d513-4c10-bf51-e3f13a72092d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86", "tag": "50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:17.276026 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:17.276516 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:17.276952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:17.277905 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:17.278353 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:17.278994 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:17.284433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-49d72af5-9b77-4136-877c-8ada874ecad4 req-477a7e03-d513-4c10-bf51-e3f13a72092d service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:17.285067 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-49d72af5-9b77-4136-877c-8ada874ecad4 req-477a7e03-d513-4c10-bf51-e3f13a72092d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:17.285501 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-49d72af5-9b77-4136-877c-8ada874ecad4 req-477a7e03-d513-4c10-bf51-e3f13a72092d service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:17.298736 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-49d72af5-9b77-4136-877c-8ada874ecad4 req-477a7e03-d513-4c10-bf51-e3f13a72092d service nova] Creating event network-changed:50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e for instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 on hv-cinder-85625 Sep 07 13:45:17.304663 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-49d72af5-9b77-4136-877c-8ada874ecad4 req-477a7e03-d513-4c10-bf51-e3f13a72092d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037901 Sep 07 13:45:17.306085 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 600/1190] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:45:17.375983 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lazy-loading 'services' on Instance uuid dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:45:17.729106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-81f279fb-f469-4fe6-8ff3-55c940c9a052 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments/1edd849f-7076-4897-8cb7-e63e2e347b2c" status: 202 len: 0 microversion: 2.1 time: 0.465366 Sep 07 13:45:17.729723 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 591/1191] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:45:17 2022] DELETE /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments/1edd849f-7076-4897-8cb7-e63e2e347b2c => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:45:17.738830 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:17.742893 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:17.750633 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:17.751550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:17.752243 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:17.752911 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:17.753534 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:17.754124 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:17.789866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-131e3312-0c03-43d6-9d68-bf038afca69f tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055142 Sep 07 13:45:17.792049 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 601/1192] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:17 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:18.807073 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:18.809476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:18.815894 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:18.824309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:18.824309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:18.824309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:18.824309 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:18.825031 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:18.854458 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-a527b02d-b719-4619-9da0-1b2af0b7a69b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053759 Sep 07 13:45:18.858543 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 592/1193] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:18 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:19.868481 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:19.870814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:19.876925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.877416 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.877850 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:19.878549 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.879024 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.879451 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:19.913105 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-a3740474-cc28-4166-974b-6d0ddb158e78 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049458 Sep 07 13:45:19.914372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 602/1194] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:19 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:45:19.925437 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:19.925948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:19.933435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.933921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.934366 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:19.935093 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.935547 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.935970 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:20.013189 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] HTTP exception thrown: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 is not attached to volume 1edd849f-7076-4897-8cb7-e63e2e347b2c Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Request method failure captured: Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: DELETE /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments/1edd849f-7076-4897-8cb7-e63e2e347b2c HTTP/1.1 Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ_hiG-PvfP-ERjJ14GixDdv1rWTdSegvdzAXcuYgfRLDKaomLv9PmdCU-4tJqWKwpOMjQU6wtGjt8AaiykHvNfo4Wcion58Ol6CJXgcFO3D_9BhtpscA2a-UQoeFh-2wnmDpfl1CVqBfDAnZGtsZK93NY9hQxr_E8A2p1aPadzCg6E Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: b933078b01aa4e3b82e37fef9b6ff92c Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-TestMinimumBasicScenario-941081432 Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:45:20.015721 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b933078b01aa4e3b82e37fef9b6ff92c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b933078b01aa4e3b82e37fef9b6ff92c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b933078b01aa4e3b82e37fef9b6ff92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b933078b01aa4e3b82e37fef9b6ff92c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-TestMinimumBasicScenario-941081432 Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: b933078b01aa4e3b82e37fef9b6ff92c Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-TestMinimumBasicScenario-941081432 Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-TestMinimumBasicScenario-941081432-project Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 8895cee0f4444866bd4c3908eb248543 Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-TestMinimumBasicScenario-941081432-project Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:45:20.019480 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 is not attached to volume 1edd849f-7076-4897-8cb7-e63e2e347b2c Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'server_id': 'dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86', 'id': '1edd849f-7076-4897-8cb7-e63e2e347b2c'} Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1edd849f-7076-4897-8cb7-e63e2e347b2c. Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:45:20.020419 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 is not attached to volume 1edd849f-7076-4897-8cb7-e63e2e347b2c Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 is not attached to volume 1edd849f-7076-4897-8cb7-e63e2e347b2c Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:45:20.022084 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Returning 404 to user: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 is not attached to volume 1edd849f-7076-4897-8cb7-e63e2e347b2c {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:45:20.023403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-385741b3-86a4-4c4f-b858-c1a58e721309 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments/1edd849f-7076-4897-8cb7-e63e2e347b2c" status: 404 len: 154 microversion: 2.1 time: 0.096969 Sep 07 13:45:20.023403 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 593/1195] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 7 13:45:19 2022] DELETE /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86/os-volume_attachments/1edd849f-7076-4897-8cb7-e63e2e347b2c => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:45:21.369652 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:21.370219 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:21.376777 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:21.377254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:21.377685 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:21.378375 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:21.378825 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:21.379262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:21.405433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:45:21.822753 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-58c5860f-9a8a-429a-a08a-d85f4fe5186e tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 204 len: 0 microversion: 2.1 time: 0.457452 Sep 07 13:45:21.824148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 603/1196] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:45:21 2022] DELETE /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:45:21.831808 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:21.832539 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:21.839753 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:21.840246 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:21.840688 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:21.841394 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:21.841851 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:21.842275 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:21.982284 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:21.990305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3a26a98e-3dd1-42c1-9be0-47dd3899ca6c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1553 microversion: 2.1 time: 0.162519 Sep 07 13:45:21.990874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 594/1197] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:21 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:23.013724 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:23.014537 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:23.021561 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:23.022048 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:23.022534 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:23.023262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:23.023713 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:23.024138 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:23.167993 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:23.175886 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-730f1c5f-c238-4a02-badb-513e8c807a6d tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1553 microversion: 2.1 time: 0.166657 Sep 07 13:45:23.176456 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 604/1198] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:23 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:24.207752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:24.207752 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:24.208507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:24.208507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:24.208953 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:24.209878 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:24.210334 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:24.210749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:24.425037 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:24.434223 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-5d5cf33c-ab0e-4efa-a2c0-024e13b2eaec tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1553 microversion: 2.1 time: 0.237548 Sep 07 13:45:24.434839 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 595/1199] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:24 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:24.658683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-cd3fa36e-5d72-4ae5-85c6-8561c555e3fd req-02da2741-1010-4295-91aa-e824c349b0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86", "name": "network-vif-deleted", "tag": "50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:24.668814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-cd3fa36e-5d72-4ae5-85c6-8561c555e3fd req-02da2741-1010-4295-91aa-e824c349b0fd service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:24.669313 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-cd3fa36e-5d72-4ae5-85c6-8561c555e3fd req-02da2741-1010-4295-91aa-e824c349b0fd service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:24.669787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-cd3fa36e-5d72-4ae5-85c6-8561c555e3fd req-02da2741-1010-4295-91aa-e824c349b0fd service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:24.682814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-cd3fa36e-5d72-4ae5-85c6-8561c555e3fd req-02da2741-1010-4295-91aa-e824c349b0fd service nova] Creating event network-vif-deleted:50b2ecae-cd4e-4eeb-83b3-fac3b38f0c2e for instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 on hv-cinder-85625 Sep 07 13:45:24.688041 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-cd3fa36e-5d72-4ae5-85c6-8561c555e3fd req-02da2741-1010-4295-91aa-e824c349b0fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033145 Sep 07 13:45:24.688679 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 605/1200] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:25.461103 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:25.461778 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:25.470007 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:25.470514 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:25.470952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:25.471699 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:25.472160 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:25.473101 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:25.510271 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:25.510846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:25.511239 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:25.511835 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lazy-loading 'fault' on Instance uuid dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:45:25.557874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895cee0f4444866bd4c3908eb248543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b933078b01aa4e3b82e37fef9b6ff92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:25.565964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-6da4c223-3b3d-4206-89c0-fe018b7afec1 tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 200 len: 1347 microversion: 2.1 time: 0.108920 Sep 07 13:45:25.567297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 596/1201] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:25 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 1347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:26.590864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:26.591624 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] [instance: dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:26.599152 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:26.599631 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:26.600460 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:26.601162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:26.601734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:26.602660 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:26.617409 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] HTTP exception thrown: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 could not be found. Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Request method failure captured: Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 HTTP/1.1 Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ_hiG-PvfP-ERjJ14GixDdv1rWTdSegvdzAXcuYgfRLDKaomLv9PmdCU-4tJqWKwpOMjQU6wtGjt8AaiykHvNfo4Wcion58Ol6CJXgcFO3D_9BhtpscA2a-UQoeFh-2wnmDpfl1CVqBfDAnZGtsZK93NY9hQxr_E8A2p1aPadzCg6E Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: b933078b01aa4e3b82e37fef9b6ff92c Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-TestMinimumBasicScenario-941081432 Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:45:26.619693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b933078b01aa4e3b82e37fef9b6ff92c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b933078b01aa4e3b82e37fef9b6ff92c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b933078b01aa4e3b82e37fef9b6ff92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b933078b01aa4e3b82e37fef9b6ff92c", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-TestMinimumBasicScenario-941081432 Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: b933078b01aa4e3b82e37fef9b6ff92c Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-TestMinimumBasicScenario-941081432 Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-TestMinimumBasicScenario-941081432-project Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 8895cee0f4444866bd4c3908eb248543 Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-TestMinimumBasicScenario-941081432-project Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 could not be found. Sep 07 13:45:26.621521 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': 'dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86'} Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 could not be found. Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:45:26.622543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 could not be found. Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 could not be found. Sep 07 13:45:26.624309 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:45:26.625874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Returning 404 to user: Instance dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:45:26.625874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-de7a4f91-665e-43ad-8b90-f8db0d14091b tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86" status: 404 len: 111 microversion: 2.1 time: 0.034593 Sep 07 13:45:26.625874 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 606/1202] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:26 2022] GET /compute/v2.1/servers/dd7dca4a-9147-471e-bb4f-ffbcd0ddfe86 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:45:26.630324 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c7f1cabe-1dce-4ef2-9bf6-e892dc59355c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] Calling method '.version_select at 0x7f174c14c4c0>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:26.715202 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c7f1cabe-1dce-4ef2-9bf6-e892dc59355c tempest-TestMinimumBasicScenario-941081432 tempest-TestMinimumBasicScenario-941081432-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-127697865" status: 202 len: 0 microversion: 2.1 time: 0.088653 Sep 07 13:45:26.715799 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 597/1203] 10.222.0.62 () {58 vars in 1269 bytes} [Wed Sep 7 13:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-127697865 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:45:54.986148 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:54.986838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:54.987686 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:54.988728 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:54.992832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-7c7f6568-536d-42b5-ac5a-9649915fac33 req-b7a58031-1234-4fb2-a4cd-d67370f0aba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b03803f6-7a36-4a80-8dbb-3e1ee64b07ff", "tag": "eef052d3-2830-45b1-8172-dff7206918fa"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:54.993397 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:54.994648 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:54.996078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:54.996575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:54.997010 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:54.998032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:54.998453 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:54.998939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:55.004958 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-7c7f6568-536d-42b5-ac5a-9649915fac33 req-b7a58031-1234-4fb2-a4cd-d67370f0aba8 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:55.005651 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-7c7f6568-536d-42b5-ac5a-9649915fac33 req-b7a58031-1234-4fb2-a4cd-d67370f0aba8 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:55.006088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-7c7f6568-536d-42b5-ac5a-9649915fac33 req-b7a58031-1234-4fb2-a4cd-d67370f0aba8 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:55.018468 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-7c7f6568-536d-42b5-ac5a-9649915fac33 req-b7a58031-1234-4fb2-a4cd-d67370f0aba8 service nova] Creating event network-changed:eef052d3-2830-45b1-8172-dff7206918fa for instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff on hv-cinder-85625 Sep 07 13:45:55.023868 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-7c7f6568-536d-42b5-ac5a-9649915fac33 req-b7a58031-1234-4fb2-a4cd-d67370f0aba8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038731 Sep 07 13:45:55.024659 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 598/1204] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:55.032455 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Going to try to terminate instance {{(pid=151551) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:45:55.674082 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-83cb0b4c-ad66-4718-b9d2-ae2f672df093 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 204 len: 0 microversion: 2.1 time: 0.691757 Sep 07 13:45:55.674764 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 607/1205] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:45:54 2022] DELETE /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:45:55.700775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:55.701482 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:55.710109 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:55.710603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:55.711085 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:55.711792 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:55.712250 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:55.712684 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:55.863551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:55.871961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-21bdff47-b030-454f-87fc-593a2caec752 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1578 microversion: 2.1 time: 0.175395 Sep 07 13:45:55.872554 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 599/1206] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:55 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:56.898472 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:56.899210 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:56.907400 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:56.909231 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:56.909231 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:56.909231 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:56.909576 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:56.909885 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:57.055307 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:57.063798 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cfe66382-3974-4352-af9c-03a5ca2fbeb6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1459 microversion: 2.1 time: 0.170496 Sep 07 13:45:57.064372 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 608/1207] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:56 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1459 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:57.993693 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-93b265bb-1c09-4105-84bc-79aa659643b6 req-3d7fe5d9-2f72-4a77-b93a-e1fabcd5920b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03803f6-7a36-4a80-8dbb-3e1ee64b07ff", "name": "network-vif-deleted", "tag": "eef052d3-2830-45b1-8172-dff7206918fa"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:58.004724 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-93b265bb-1c09-4105-84bc-79aa659643b6 req-3d7fe5d9-2f72-4a77-b93a-e1fabcd5920b service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:58.005205 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-93b265bb-1c09-4105-84bc-79aa659643b6 req-3d7fe5d9-2f72-4a77-b93a-e1fabcd5920b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:58.005680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-93b265bb-1c09-4105-84bc-79aa659643b6 req-3d7fe5d9-2f72-4a77-b93a-e1fabcd5920b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:58.017305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-93b265bb-1c09-4105-84bc-79aa659643b6 req-3d7fe5d9-2f72-4a77-b93a-e1fabcd5920b service nova] Creating event network-vif-deleted:eef052d3-2830-45b1-8172-dff7206918fa for instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff on hv-cinder-85625 Sep 07 13:45:58.022615 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-93b265bb-1c09-4105-84bc-79aa659643b6 req-3d7fe5d9-2f72-4a77-b93a-e1fabcd5920b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033625 Sep 07 13:45:58.023273 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 600/1208] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:58.087871 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:58.088485 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:58.095864 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:58.096289 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:58.096731 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:58.097433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:58.097891 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:58.098325 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:58.165755 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:58.174147 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-dca325a1-2c84-4335-961f-5a8d9b76f918 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1392 microversion: 2.1 time: 0.090333 Sep 07 13:45:58.174733 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 609/1209] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:58 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1392 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:59.200399 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:59.201080 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:59.208925 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:59.209333 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:59.209767 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:59.210461 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:59.210915 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:59.211356 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:59.246894 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:59.247406 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:59.247836 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:59.248274 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lazy-loading 'fault' on Instance uuid b03803f6-7a36-4a80-8dbb-3e1ee64b07ff {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:45:59.292551 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:59.300575 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-21d18c19-3aa4-49af-879a-a65c62edf088 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 200 len: 1231 microversion: 2.1 time: 0.104289 Sep 07 13:45:59.301212 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 601/1210] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:59 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:00.324517 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:00.325150 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: b03803f6-7a36-4a80-8dbb-3e1ee64b07ff] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:00.332410 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:00.332901 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:00.333343 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:00.334053 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:00.334508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:00.334931 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:00.350929 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] HTTP exception thrown: Instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff could not be found. Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Request method failure captured: Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff HTTP/1.1 Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ6z2McoqgrcY0DeWvCCkVmFDvyLaB1UdYJ4Mz6MneFnCd7dRydRkE9-Kq1K6qH4mBcYeKW1EuPkT0Vo3_dwfXIHWSq2EgobPYuGlIp3znT6j1_R3XOu6OfIrdcmbVZV95I_Auv12X_W5qiN6TFW9esPDnCfPMkdkGCaC0hah_42mBA Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:46:00.352641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b4d5ce9b4fe34fc094bdacc3ca994537", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 9dae215cd92f46d18a3c1b7389c3af4b Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff could not be found. Sep 07 13:46:00.354580 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': 'b03803f6-7a36-4a80-8dbb-3e1ee64b07ff'} Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff could not be found. Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:00.355551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff could not be found. Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff could not be found. Sep 07 13:46:00.357550 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:00.359113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Returning 404 to user: Instance b03803f6-7a36-4a80-8dbb-3e1ee64b07ff could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:00.359113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-aba08716-43b3-41e9-a59d-b4959e8af8b2 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff" status: 404 len: 111 microversion: 2.1 time: 0.033498 Sep 07 13:46:00.359113 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 610/1211] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:00 2022] GET /compute/v2.1/servers/b03803f6-7a36-4a80-8dbb-3e1ee64b07ff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:46:04.168496 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:04.169114 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:04.170801 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-c4d90c6f-4713-41af-8a83-26deee00df9f req-6cab0436-0140-49d4-a72e-385fb941e42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41d2be4-ca91-4189-9b6e-c36b1ed6638b", "tag": "03490dab-650b-4910-8afd-c09a150bf2c5"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:04.177343 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:04.177843 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:04.178361 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:04.179118 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:04.179718 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:04.180013 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:04.183591 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c4d90c6f-4713-41af-8a83-26deee00df9f req-6cab0436-0140-49d4-a72e-385fb941e42b service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:04.184587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c4d90c6f-4713-41af-8a83-26deee00df9f req-6cab0436-0140-49d4-a72e-385fb941e42b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:04.185240 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c4d90c6f-4713-41af-8a83-26deee00df9f req-6cab0436-0140-49d4-a72e-385fb941e42b service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:04.199069 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-c4d90c6f-4713-41af-8a83-26deee00df9f req-6cab0436-0140-49d4-a72e-385fb941e42b service nova] Creating event network-changed:03490dab-650b-4910-8afd-c09a150bf2c5 for instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b on hv-cinder-85625 Sep 07 13:46:04.206019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-c4d90c6f-4713-41af-8a83-26deee00df9f req-6cab0436-0140-49d4-a72e-385fb941e42b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039125 Sep 07 13:46:04.207468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 611/1212] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:46:04.212385 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Going to try to terminate instance {{(pid=151552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:46:04.600635 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-95274733-68c1-4b71-94aa-19d1c1ca093d tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 204 len: 0 microversion: 2.1 time: 0.436007 Sep 07 13:46:04.605348 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 602/1213] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:46:04 2022] DELETE /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:46:04.613118 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:04.614758 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:04.623125 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:04.625117 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:04.625835 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:04.627140 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:04.627693 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:04.628511 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:04.780971 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:04.789787 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b324d9d8-25f9-4570-a2a2-1ebdbf3a9e38 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1575 microversion: 2.1 time: 0.181692 Sep 07 13:46:04.790370 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 612/1214] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:04 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:05.815609 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:05.816438 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:05.824702 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:05.825456 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:05.826106 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:05.827089 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:05.827832 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:05.828272 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:05.969305 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:05.977441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-fd6c944e-e3b2-4626-a590-e6817b388054 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1575 microversion: 2.1 time: 0.166848 Sep 07 13:46:05.978032 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 603/1215] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:05 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:06.862022 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-7a92ddfb-38d2-4f27-9d0d-190afc1d305a req-cc62e005-785f-49b1-a96d-5d0dbc0ba311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41d2be4-ca91-4189-9b6e-c36b1ed6638b", "name": "network-vif-deleted", "tag": "03490dab-650b-4910-8afd-c09a150bf2c5"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:06.872868 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-7a92ddfb-38d2-4f27-9d0d-190afc1d305a req-cc62e005-785f-49b1-a96d-5d0dbc0ba311 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:06.873350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-7a92ddfb-38d2-4f27-9d0d-190afc1d305a req-cc62e005-785f-49b1-a96d-5d0dbc0ba311 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:06.873782 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-7a92ddfb-38d2-4f27-9d0d-190afc1d305a req-cc62e005-785f-49b1-a96d-5d0dbc0ba311 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:06.886737 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-7a92ddfb-38d2-4f27-9d0d-190afc1d305a req-cc62e005-785f-49b1-a96d-5d0dbc0ba311 service nova] Creating event network-vif-deleted:03490dab-650b-4910-8afd-c09a150bf2c5 for instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b on hv-cinder-85625 Sep 07 13:46:06.892721 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-7a92ddfb-38d2-4f27-9d0d-190afc1d305a req-cc62e005-785f-49b1-a96d-5d0dbc0ba311 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Sep 07 13:46:06.893508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 613/1216] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:07.003809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:07.004446 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:07.015369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:07.015369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:07.015369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:07.015369 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:07.015842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:07.015842 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:07.085297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:07.093265 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-7a65bbf5-54fd-489f-81db-1a0b980174b5 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1390 microversion: 2.1 time: 0.094150 Sep 07 13:46:07.094089 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 604/1217] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:06 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:08.117099 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:08.117805 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:08.124173 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:08.130728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:08.130728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:08.130728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:08.130728 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:08.131469 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:08.159219 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:08.159701 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:08.160143 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:08.160587 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lazy-loading 'fault' on Instance uuid f41d2be4-ca91-4189-9b6e-c36b1ed6638b {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:46:08.204412 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae215cd92f46d18a3c1b7389c3af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d5ce9b4fe34fc094bdacc3ca994537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:08.212533 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f577a04e-1541-4732-829b-9bc82849875b tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 200 len: 1229 microversion: 2.1 time: 0.100117 Sep 07 13:46:08.213131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 614/1218] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:08 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:09.237240 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:09.237870 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: f41d2be4-ca91-4189-9b6e-c36b1ed6638b] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:09.244295 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.244772 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.245268 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.245887 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.246493 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.247086 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.262672 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] HTTP exception thrown: Instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b could not be found. Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Request method failure captured: Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b HTTP/1.1 Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ6z2McoqgrcY0DeWvCCkVmFDvyLaB1UdYJ4Mz6MneFnCd7dRydRkE9-Kq1K6qH4mBcYeKW1EuPkT0Vo3_dwfXIHWSq2EgobPYuGlIp3znT6j1_R3XOu6OfIrdcmbVZV95I_Auv12X_W5qiN6TFW9esPDnCfPMkdkGCaC0hah_42mBA Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:46:09.264365 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b4d5ce9b4fe34fc094bdacc3ca994537", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 9dae215cd92f46d18a3c1b7389c3af4b Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b could not be found. Sep 07 13:46:09.266070 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': 'f41d2be4-ca91-4189-9b6e-c36b1ed6638b'} Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b could not be found. Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:09.267355 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b could not be found. Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b could not be found. Sep 07 13:46:09.268854 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.270401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Returning 404 to user: Instance f41d2be4-ca91-4189-9b6e-c36b1ed6638b could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:09.270401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c73f29be-a5ef-4eb5-98e4-7386349d7d0c tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b" status: 404 len: 111 microversion: 2.1 time: 0.033349 Sep 07 13:46:09.270401 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 605/1219] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:09 2022] GET /compute/v2.1/servers/f41d2be4-ca91-4189-9b6e-c36b1ed6638b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:46:09.769749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:09.775887 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:09.777433 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.778038 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.778357 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.779095 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.779556 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.779972 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.795607 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.wsgi [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] HTTP exception thrown: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Request method failure captured: Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: request: DELETE /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa HTTP/1.1 Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept: application/json Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Accept-Encoding: identity Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Connection: close Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Length: 0 Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Content-Type: application/json Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Host: 10.222.0.62 Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Openstack-System-Scope: None Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Auth-Token: gAAAAABjGJ6z2McoqgrcY0DeWvCCkVmFDvyLaB1UdYJ4Mz6MneFnCd7dRydRkE9-Kq1K6qH4mBcYeKW1EuPkT0Vo3_dwfXIHWSq2EgobPYuGlIp3znT6j1_R3XOu6OfIrdcmbVZV95I_Auv12X_W5qiN6TFW9esPDnCfPMkdkGCaC0hah_42mBA Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Id: None Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Domain-Name: None Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Identity-Status: Confirmed Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Is-Admin-Project: True Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Id: default Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Domain-Name: Default Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Project-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Role: reader,member Sep 07 13:46:09.798838 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Roles: reader,member Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b4d5ce9b4fe34fc094bdacc3ca994537", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-Tenant-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Id: default Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Domain-Name: Default Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Id: 9dae215cd92f46d18a3c1b7389c3af4b Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: X-User-Name: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: method: > Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: exception: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.802254 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: action_args: {'id': '628c7746-90a9-47ed-a112-e91e1a62c0aa'} Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:09.804278 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.806675 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.809078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Returning 404 to user: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. {{(pid=151551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:09.809078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-5e61b4ca-0437-4207-a7f0-7f29a496ceff tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "DELETE /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 404 len: 111 microversion: 2.1 time: 0.033738 Sep 07 13:46:09.809078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 615/1220] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:46:09 2022] DELETE /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:46:09.810214 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:09.810861 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] [instance: 628c7746-90a9-47ed-a112-e91e1a62c0aa] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:09.817602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.818108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.818552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.819436 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.819899 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.820327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.835820 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] HTTP exception thrown: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Request method failure captured: Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa HTTP/1.1 Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGJ6z2McoqgrcY0DeWvCCkVmFDvyLaB1UdYJ4Mz6MneFnCd7dRydRkE9-Kq1K6qH4mBcYeKW1EuPkT0Vo3_dwfXIHWSq2EgobPYuGlIp3znT6j1_R3XOu6OfIrdcmbVZV95I_Auv12X_W5qiN6TFW9esPDnCfPMkdkGCaC0hah_42mBA Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:46:09.837370 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b4d5ce9b4fe34fc094bdacc3ca994537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b4d5ce9b4fe34fc094bdacc3ca994537", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: b4d5ce9b4fe34fc094bdacc3ca994537 Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-TestVolumeBootPattern-1116536669 Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 9dae215cd92f46d18a3c1b7389c3af4b Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-TestVolumeBootPattern-1116536669-project Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.839156 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '628c7746-90a9-47ed-a112-e91e1a62c0aa'} Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:09.840441 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. Sep 07 13:46:09.842184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:46:09.844373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Returning 404 to user: Instance 628c7746-90a9-47ed-a112-e91e1a62c0aa could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:09.844373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-757e3645-82fa-4a53-9131-0f66144fd216 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa" status: 404 len: 111 microversion: 2.1 time: 0.033424 Sep 07 13:46:09.844373 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 606/1221] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:09 2022] GET /compute/v2.1/servers/628c7746-90a9-47ed-a112-e91e1a62c0aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:46:11.433760 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-54f78ed3-fe3b-4d79-af3a-9b79e410c5b6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] Calling method '.version_select at 0x7f1747e13f70>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:11.542018 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-54f78ed3-fe3b-4d79-af3a-9b79e410c5b6 tempest-TestVolumeBootPattern-1116536669 tempest-TestVolumeBootPattern-1116536669-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1952784259" status: 202 len: 0 microversion: 2.1 time: 0.113047 Sep 07 13:46:11.542582 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 616/1222] 10.222.0.62 () {58 vars in 1263 bytes} [Wed Sep 7 13:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1952784259 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:47:03.017907 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:03.018600 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:03.022067 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:03.022736 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:03.027985 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:03.028477 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:03.028921 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:03.029647 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:03.030117 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:03.030549 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:03.055999 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.objects.instance [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lazy-loading 'flavor' on Instance uuid 720272c0-a76c-4ffa-9919-9e7de8ae67d4 {{(pid=151552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:47:03.595857 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-3b4559dc-8f62-4c91-80b5-0313261f4698 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "POST /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4/action" status: 202 len: 0 microversion: 2.1 time: 0.581742 Sep 07 13:47:03.596386 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 607/1223] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:47:03 2022] POST /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:47:03.603772 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:03.605740 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:03.608759 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:03.609386 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:03.618068 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:03.618617 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:03.619079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:03.619800 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:03.620249 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:03.620678 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:03.760869 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:03.768979 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-34218cf8-2e21-47f1-9e68-3ff6dd48843a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.167642 Sep 07 13:47:03.769543 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 617/1224] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:03 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:04.799199 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:04.800508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:04.808751 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:04.809243 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:04.809680 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:04.810393 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:04.810853 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:04.811315 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:04.965909 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:04.974337 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-1af902aa-3187-4781-910b-b0870892e442 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.183605 Sep 07 13:47:04.974948 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 608/1225] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:04 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:06.001438 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:06.002092 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:06.011863 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:06.012350 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:06.012788 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:06.013491 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:06.013946 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:06.014374 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:06.157004 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:06.164848 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-c206341a-d301-40d0-9c59-55c409bd8e86 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.169392 Sep 07 13:47:06.165417 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 618/1226] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:05 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:47:07.188915 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:07.189585 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:07.196287 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:07.196780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:07.197215 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:07.198147 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:07.198606 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:07.199060 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:07.343808 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:07.352595 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-75496c89-97b6-4b4d-b1a7-2e5c284d99d5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.167536 Sep 07 13:47:07.353177 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 609/1227] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:07 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:08.376019 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:08.376628 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:08.383431 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:08.387376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:08.387376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:08.387376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:08.387376 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:08.387794 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:08.535051 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:08.544153 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-67172d50-e4c9-424c-a970-9e2e14941706 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.171905 Sep 07 13:47:08.544723 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 619/1228] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:08 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:09.568911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:09.569507 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:09.576146 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:09.576617 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:09.577045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:09.577787 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:09.578194 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:09.578612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:09.721873 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:09.730052 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-780547f7-d2a6-47b0-8e5f-7bc1b7730880 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.165735 Sep 07 13:47:09.730639 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 610/1229] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:09 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:10.754568 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:10.755292 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:10.762107 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:10.762593 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:10.763078 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:10.764169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:10.764169 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:10.764756 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:10.917768 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:10.925765 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-08a58580-2b35-49a4-80db-c459fb974ad5 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.175228 Sep 07 13:47:10.926336 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 620/1230] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:10 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:11.950409 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:11.951044 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:11.957372 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:11.957846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:11.958395 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:11.959184 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:11.959632 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:11.960045 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:12.100671 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:12.109103 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-14237a63-fcfc-47af-bf39-98800600ad6d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.162504 Sep 07 13:47:12.110602 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 611/1231] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:11 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:13.134756 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:13.135442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:13.142081 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:13.142558 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:13.143012 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:13.143710 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:13.144154 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:13.144575 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:13.285866 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:13.294209 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-58af34d3-6549-4716-841a-efbee20c04e4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.164075 Sep 07 13:47:13.294776 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 621/1232] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:13 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:14.318250 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:14.319167 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:14.326362 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:14.326838 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:14.327293 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:14.327986 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:14.328435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:14.328860 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:14.543686 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:14.552213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-637402fa-38a0-407a-95e9-42e1e214fc42 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.238065 Sep 07 13:47:14.552213 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 612/1233] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:14 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:15.575939 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:15.576508 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:15.584058 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:15.584548 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:15.584981 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:15.585686 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:15.586131 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:15.586551 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:15.719336 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:15.727204 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-cacc5d47-ee52-42a6-b42b-3a87c486f8dc tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.155153 Sep 07 13:47:15.727766 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 622/1234] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:15 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:16.752672 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:16.753690 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:16.761320 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:16.761748 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:16.762187 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:16.762989 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:16.763448 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:16.763874 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:16.909804 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:16.917035 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-4cb9583c-ad1e-49d4-8bea-f342551a9d80 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.169084 Sep 07 13:47:16.917618 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 613/1235] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:16 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:17.944435 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:17.945146 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:17.952201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:17.952688 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:17.953155 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:17.954371 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:17.954877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:17.955333 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:18.122734 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:18.131631 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e4c948cb-aad3-4a98-bb60-421cdf687923 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1510 microversion: 2.1 time: 0.192904 Sep 07 13:47:18.132202 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 623/1236] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:17 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:18.164996 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:18.165603 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:18.172270 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:18.172814 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:18.173297 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:18.174005 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:18.174568 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:18.175016 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:18.218435 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=151552) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:47:18.580880 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-75bc88a6-118c-408b-b375-e3ffd37b5a41 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "POST /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4/action" status: 202 len: 0 microversion: 2.1 time: 0.420675 Sep 07 13:47:18.581550 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 614/1237] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 7 13:47:18 2022] POST /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:47:18.591184 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:18.591812 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:18.597997 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:18.598536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:18.599598 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:18.600297 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:18.600752 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:18.601180 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:18.746666 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:18.754720 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-83f4774c-8833-4892-b881-0b292683a6b1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1518 microversion: 2.1 time: 0.167726 Sep 07 13:47:18.767141 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 624/1238] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:18 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:19.782341 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:19.782961 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:19.789846 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:19.790329 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:19.790764 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:19.791614 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:19.792081 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:19.792512 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:19.931386 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:19.939990 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-415a99e3-633a-453f-ba3e-abb8337b7174 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1518 microversion: 2.1 time: 0.162495 Sep 07 13:47:19.940710 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 615/1239] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:19 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:20.964338 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:20.965075 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:20.972262 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:20.972750 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:20.973191 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:20.973894 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:20.974348 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:20.975316 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:21.130802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:21.139312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-f13544e8-0c0b-40ca-a5d2-097fcda0ec76 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1520 microversion: 2.1 time: 0.178973 Sep 07 13:47:21.139887 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 625/1240] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:20 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:21.598303 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-a0c7382c-432c-4514-96bb-047ddde865f6 req-9a9a685e-69f7-414f-918a-9457ae1bb39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720272c0-a76c-4ffa-9919-9e7de8ae67d4", "name": "network-vif-unplugged", "status": "completed", "tag": "4b7ed7f0-d994-44b6-b1e2-b89cd4681072"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:21.612253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a0c7382c-432c-4514-96bb-047ddde865f6 req-9a9a685e-69f7-414f-918a-9457ae1bb39a service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:21.612253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a0c7382c-432c-4514-96bb-047ddde865f6 req-9a9a685e-69f7-414f-918a-9457ae1bb39a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:21.612253 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-a0c7382c-432c-4514-96bb-047ddde865f6 req-9a9a685e-69f7-414f-918a-9457ae1bb39a service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:21.621952 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-a0c7382c-432c-4514-96bb-047ddde865f6 req-9a9a685e-69f7-414f-918a-9457ae1bb39a service nova] Creating event network-vif-unplugged:4b7ed7f0-d994-44b6-b1e2-b89cd4681072 for instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 on hv-cinder-85625 Sep 07 13:47:21.627112 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-a0c7382c-432c-4514-96bb-047ddde865f6 req-9a9a685e-69f7-414f-918a-9457ae1bb39a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032498 Sep 07 13:47:21.627714 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 616/1241] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:22.164027 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:22.164683 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:22.171827 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:22.172319 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:22.172749 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:22.173449 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:22.173892 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:22.174311 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:22.322542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:22.330814 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-23caf513-1671-4b03-93fc-0c25ef0b743a tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.171148 Sep 07 13:47:22.344103 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 626/1242] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:22 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:23.355006 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:23.355753 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:23.363234 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:23.363726 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:23.364178 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:23.364911 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:23.365420 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:23.366017 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:23.516306 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:23.526289 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-dc3413dd-fc65-49e4-ac73-ff1724a85f70 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.176173 Sep 07 13:47:23.526883 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 617/1243] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:23 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:24.549930 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:24.550542 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:24.557554 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:24.558037 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:24.558621 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:24.559343 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:24.559802 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:24.560232 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:24.701504 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:24.711583 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fd818cbd-1c6e-4ac9-bf0c-26e50193002d tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.165510 Sep 07 13:47:24.712194 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 627/1244] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:24 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:25.735560 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:25.736116 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:25.743798 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:25.744283 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:25.744720 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:25.745464 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:25.745919 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:25.746347 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:25.883935 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:25.892082 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-ee47da14-6d2a-4db7-858b-a25b9762eb73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.160327 Sep 07 13:47:25.892668 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 618/1245] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:25 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:26.918328 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:26.918924 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:26.926201 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:26.926687 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:26.927229 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:26.927996 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:26.928483 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:26.929115 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:27.072450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:27.080752 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-041e4149-fdcc-488c-9246-6c09d94f8d73 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.166523 Sep 07 13:47:27.081335 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 628/1246] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:26 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:28.105913 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:28.106666 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:28.113760 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:28.114327 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:28.114809 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:28.115826 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:28.116300 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:28.116747 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:28.267912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:28.277593 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-897211ac-d344-4ca8-ba0e-3c73f82ca967 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.175959 Sep 07 13:47:28.278198 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 619/1247] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:28 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:29.301570 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:29.302190 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:29.309429 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:29.309919 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:29.310360 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:29.311079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:29.311536 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:29.311959 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:29.449032 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:29.457312 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-250ad334-81c1-45e9-a9d1-2d4c95a50d99 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.159610 Sep 07 13:47:29.457904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 629/1248] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:29 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:30.482008 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:30.482628 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:30.489120 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:30.489595 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:30.490078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:30.491306 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:30.491775 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:30.492197 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:30.633598 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:30.641817 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-b0d013c4-eb55-423e-a434-ef31a71451fe tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.163756 Sep 07 13:47:30.642411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 620/1249] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:30 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:31.666475 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:31.667162 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:31.673841 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:31.674326 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:31.674754 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:31.675476 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:31.675925 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:31.676344 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:31.721871 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [req-25a59bb0-a2d1-4f13-9753-b5df2822b152 req-aa3339c1-c72b-4e4e-9d45-ac17230e0fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720272c0-a76c-4ffa-9919-9e7de8ae67d4", "name": "network-vif-plugged", "status": "completed", "tag": "4b7ed7f0-d994-44b6-b1e2-b89cd4681072"}]} {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:31.734080 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-25a59bb0-a2d1-4f13-9753-b5df2822b152 req-aa3339c1-c72b-4e4e-9d45-ac17230e0fa9 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:31.739210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-25a59bb0-a2d1-4f13-9753-b5df2822b152 req-aa3339c1-c72b-4e4e-9d45-ac17230e0fa9 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:31.739210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [req-25a59bb0-a2d1-4f13-9753-b5df2822b152 req-aa3339c1-c72b-4e4e-9d45-ac17230e0fa9 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:31.740078 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:31.749255 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.compute.server_external_events [req-25a59bb0-a2d1-4f13-9753-b5df2822b152 req-aa3339c1-c72b-4e4e-9d45-ac17230e0fa9 service nova] Creating event network-vif-plugged:4b7ed7f0-d994-44b6-b1e2-b89cd4681072 for instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 on hv-cinder-85625 Sep 07 13:47:31.754515 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [req-25a59bb0-a2d1-4f13-9753-b5df2822b152 req-aa3339c1-c72b-4e4e-9d45-ac17230e0fa9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037032 Sep 07 13:47:31.755326 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 621/1250] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:47:31.826442 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:31.835434 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-929cbf25-f382-4eb4-bc5c-20e3d7008651 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.173330 Sep 07 13:47:31.836652 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 630/1251] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:31 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:32.861837 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:32.862543 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:32.870476 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:32.871108 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:32.871436 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:32.872152 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:32.872608 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:32.873037 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:33.294881 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:33.303061 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-d7ba43dd-f11c-4c0f-a231-52a68dc72475 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1576 microversion: 2.1 time: 0.445942 Sep 07 13:47:33.303640 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 622/1252] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:32 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1576 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:34.328079 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:34.328682 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:34.335492 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:34.335989 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:34.336428 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:34.337182 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:34.337635 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:34.338064 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:34.478695 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:34.488040 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-fe350d30-aa29-49cb-af33-7c0d78d3496b tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1563 microversion: 2.1 time: 0.163907 Sep 07 13:47:34.488618 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 631/1253] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:34 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:48:47.433217 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:48:47.433964 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG dbcounter [-] [151552] Writing DB stats nova_cell1:SELECT=6 {{(pid=151552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:48:47.436498 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:48:47.436949 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Wed Sep 7 13:48:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Sep 07 13:48:47.437961 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:48:47.438105 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:48:47.438214 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: Wed Sep 7 13:48:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Sep 07 13:48:47.438559 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:48:47.438907 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_api:SELECT=30 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:48:47.439933 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG dbcounter [-] [151551] Writing DB stats nova_cell1:SELECT=90 {{(pid=151551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:48:47.444713 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-c981e716-4f67-4bbe-922c-186fb80e1eee req-4805fd90-c9e7-4173-b5f7-a034cc7c4762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720272c0-a76c-4ffa-9919-9e7de8ae67d4", "tag": "4b7ed7f0-d994-44b6-b1e2-b89cd4681072"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:48:47.451993 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:47.453975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:47.453975 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:47.454733 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:47.455328 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:47.458641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c981e716-4f67-4bbe-922c-186fb80e1eee req-4805fd90-c9e7-4173-b5f7-a034cc7c4762 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:47.458641 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c981e716-4f67-4bbe-922c-186fb80e1eee req-4805fd90-c9e7-4173-b5f7-a034cc7c4762 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:47.459012 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-c981e716-4f67-4bbe-922c-186fb80e1eee req-4805fd90-c9e7-4173-b5f7-a034cc7c4762 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:47.460016 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:47.471752 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-c981e716-4f67-4bbe-922c-186fb80e1eee req-4805fd90-c9e7-4173-b5f7-a034cc7c4762 service nova] Creating event network-changed:4b7ed7f0-d994-44b6-b1e2-b89cd4681072 for instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 on hv-cinder-85625 Sep 07 13:48:47.480656 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-c981e716-4f67-4bbe-922c-186fb80e1eee req-4805fd90-c9e7-4173-b5f7-a034cc7c4762 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045458 Sep 07 13:48:47.482486 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 632/1254] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:48:47.494903 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Going to try to terminate instance {{(pid=151552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:48:47.954298 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-c4418ce7-458f-46a0-94e2-6541b5fdbff6 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "DELETE /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 204 len: 0 microversion: 2.1 time: 0.523099 Sep 07 13:48:47.955830 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 623/1255] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 7 13:48:47 2022] DELETE /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:48:47.967158 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:48:47.976526 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:48:47.977689 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:47.978241 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:47.978688 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:47.979446 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:47.979904 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:47.980337 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:48.223280 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:48:48.228909 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-e91dce39-a72e-4810-8f7f-9e52cb1116f4 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1569 microversion: 2.1 time: 0.267458 Sep 07 13:48:48.229489 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 633/1256] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:48:47 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:48:49.254597 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:48:49.255371 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:48:49.262643 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:49.263307 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:49.263749 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:49.264469 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:49.264966 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:49.265392 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:49.462806 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:48:49.470729 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-f0f177dc-d53e-44c1-b02a-4f77b03aa482 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1450 microversion: 2.1 time: 0.221601 Sep 07 13:48:49.471400 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 624/1257] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:48:49 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1450 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:48:50.355198 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [req-0ec7718b-bc97-4a27-a9a1-26ed0d0f1f98 req-cb1676cd-5ede-409b-81e9-8051b7db37e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720272c0-a76c-4ffa-9919-9e7de8ae67d4", "name": "network-vif-deleted", "tag": "4b7ed7f0-d994-44b6-b1e2-b89cd4681072"}]} {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:48:50.365974 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-0ec7718b-bc97-4a27-a9a1-26ed0d0f1f98 req-cb1676cd-5ede-409b-81e9-8051b7db37e6 service nova] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:50.366450 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-0ec7718b-bc97-4a27-a9a1-26ed0d0f1f98 req-cb1676cd-5ede-409b-81e9-8051b7db37e6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:50.366877 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [req-0ec7718b-bc97-4a27-a9a1-26ed0d0f1f98 req-cb1676cd-5ede-409b-81e9-8051b7db37e6 service nova] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:50.378323 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.compute.server_external_events [req-0ec7718b-bc97-4a27-a9a1-26ed0d0f1f98 req-cb1676cd-5ede-409b-81e9-8051b7db37e6 service nova] Creating event network-vif-deleted:4b7ed7f0-d994-44b6-b1e2-b89cd4681072 for instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 on hv-cinder-85625 Sep 07 13:48:50.384112 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [req-0ec7718b-bc97-4a27-a9a1-26ed0d0f1f98 req-cb1676cd-5ede-409b-81e9-8051b7db37e6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Sep 07 13:48:50.384705 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 634/1258] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 7 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:48:50.494453 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:48:50.495088 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:48:50.501612 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:50.512805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:50.512805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:50.512805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:50.512805 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:50.513241 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:50.573232 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.policy [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:48:50.581655 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-822b850d-cd53-402f-874d-144d13858100 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1382 microversion: 2.1 time: 0.091062 Sep 07 13:48:50.582912 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 625/1259] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:48:50 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1382 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:48:51.606724 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:48:51.607468 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.compute.api [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151551) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:48:51.614182 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:51.614708 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:51.615176 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:51.615882 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:51.616340 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:51.616761 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:51.652181 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:51.652847 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:51.653284 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG oslo_concurrency.lockutils [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=151551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:51.657380 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.objects.instance [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lazy-loading 'fault' on Instance uuid 720272c0-a76c-4ffa-9919-9e7de8ae67d4 {{(pid=151551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:48:51.698012 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.policy [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138facb7768545999dd43217600771a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7b613bf3c94b4aa49f450be9971774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=151551) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:48:51.706133 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-77ff0f83-d76f-4ccd-9d35-55d9ed4fa397 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 200 len: 1224 microversion: 2.1 time: 0.104653 Sep 07 13:48:51.707434 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 635/1260] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:48:51 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:48:52.730192 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '>' {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:48:52.730849 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.compute.api [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] [instance: 720272c0-a76c-4ffa-9919-9e7de8ae67d4] Fetching instance by UUID {{(pid=151552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:48:52.737302 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:52.737728 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:52.738780 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:52.739720 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Acquiring lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:48:52.740210 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:48:52.740638 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG oslo_concurrency.lockutils [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Lock "3698f2aa-b5e5-4f23-8ed4-7d767b18e0d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=151552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:48:52.754959 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.wsgi [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] HTTP exception thrown: Instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 could not be found. Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Request method failure captured: Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: request: GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 HTTP/1.1 Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept: application/json Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Accept-Encoding: identity Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Connection: close Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Length: 0 Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Content-Type: application/json Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Host: 10.222.0.62 Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: Openstack-System-Scope: None Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: User-Agent: python-urllib3/1.26.12 Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Auth-Token: gAAAAABjGKAr2m2gd1QSE6C8aTRlXLwJCOitRqlDLn9VeDu32Tds2uWL_dZ_2MbTC0i27DZbd4MzAHXgMG8-YFuLJxoTmqA3ECXlnAsDxU5uyFfN-DJxDvLEc78SlnfbH9Sc5i0VwZ-5UEqEKQnRpVBWzUFgCGOeGEQuvhRvCJKHpdEeUis9uiM Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Id: None Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Domain-Name: None Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Identity-Status: Confirmed Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Is-Admin-Project: True Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Id: default Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Domain-Name: Default Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Id: bb7b613bf3c94b4aa49f450be9971774 Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Project-Name: tempest-TestShelveInstance-643536070 Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Role: reader,member Sep 07 13:48:52.756692 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Roles: reader,member Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb7b613bf3c94b4aa49f450be9971774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb7b613bf3c94b4aa49f450be9971774"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb7b613bf3c94b4aa49f450be9971774"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb7b613bf3c94b4aa49f450be9971774", "adminURL": "http://10.222.0.62:8080"}]}] Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant: tempest-TestShelveInstance-643536070 Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Id: bb7b613bf3c94b4aa49f450be9971774 Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-Tenant-Name: tempest-TestShelveInstance-643536070 Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User: tempest-TestShelveInstance-643536070-project Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Id: default Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Domain-Name: Default Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Id: 138facb7768545999dd43217600771a3 Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: X-User-Name: tempest-TestShelveInstance-643536070-project Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: method: > Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: exception: Instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 could not be found. Sep 07 13:48:52.758552 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: action_args: {'id': '720272c0-a76c-4ffa-9919-9e7de8ae67d4'} Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: {{(pid=151552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 could not be found. Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:48:52.759508 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 could not be found. Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 could not be found. Sep 07 13:48:52.761065 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: ERROR nova.api.openstack.wsgi Sep 07 13:48:52.762411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: DEBUG nova.api.openstack.wsgi [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Returning 404 to user: Instance 720272c0-a76c-4ffa-9919-9e7de8ae67d4 could not be found. {{(pid=151552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:48:52.762411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: INFO nova.api.openstack.requestlog [None req-54f886b4-c192-45e1-9990-86141eeedfd1 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4" status: 404 len: 111 microversion: 2.1 time: 0.031966 Sep 07 13:48:52.762411 dv-cinder-856259-1-iscsi devstack@n-api.service[151552]: [pid: 151552|app: 0|req: 626/1261] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 7 13:48:52 2022] GET /compute/v2.1/servers/720272c0-a76c-4ffa-9919-9e7de8ae67d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:48:53.015745 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: DEBUG nova.api.openstack.wsgi [None req-b11d1ebf-c681-45fd-be6a-b97e8bc88f66 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] Calling method '.version_select at 0x7f174f6651f0>' {{(pid=151551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:48:53.121097 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: INFO nova.api.openstack.requestlog [None req-b11d1ebf-c681-45fd-be6a-b97e8bc88f66 tempest-TestShelveInstance-643536070 tempest-TestShelveInstance-643536070-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-506453658" status: 202 len: 0 microversion: 2.1 time: 0.109193 Sep 07 13:48:53.121713 dv-cinder-856259-1-iscsi devstack@n-api.service[151551]: [pid: 151551|app: 0|req: 636/1262] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 7 13:48:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-506453658 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)